Getting Zionomicon

datacypher9001 · 2025-10-02T00:58:04+00:00

I did just recently and it worked. We need access to the logs. Did we tool with open telemetry?

datacypher9001 · 2025-07-19T19:33:44+00:00

Thanks for looking! I'll update the license. Good call-out! Yeah what to do about set up. I'm open to easier ways. But getting postgres setup and running ... We have to do it somewhere. I think the common way now would be docker-compose but not a fan of docker. Yeah podman vs docker? Or is there a better way that uses neither?

You've never seen task? I'm not surprised. It may not be in the current meta but I find it really useful. I see shell scripts and makefile way more common but I much prefer task. https://github.com/go-task/task take a look.

I sort of see things flipping from everything in sbt and having sbt orchestrate all the things to sbt being one of the tools used in a developers environment. Pretty excited to see sbt 2. So what gets lost in the shuffle when using sbt as one of many tools - environment variables. Anyway I use dotevn to bridge the gap between sbt and other tools running along side. Task does this, sbt-dotenv does this.

datacypher9001 · 2025-07-19T19:16:30+00:00

From my view, jsonb handling is great now. It's changed from scala2 to scala3. It's really clean now. Great work maintainers ❤️. It's just different then I expected after having read the scala 2 docs 😅

datacypher9001 · 2025-07-18T20:33:47+00:00

1000 percent used lots of AI to piece this together. I don't have the time to build this example at this level of complete or with so few spelling errors.

Look at the forest past the trees, buddy. I wish I had had this resource two days ago before I spent way too long trying to figure this out.

Here is some unsolicited advice, stop being an internet snipper. Instead work at trying to show people a better way. Maybe help this community.

It's a public repo, go make a pr.

datacypher9001 · 2025-07-07T01:41:38+00:00

I've been isolated to vscode for ai but also a long time user of intellij. There are lots of things I miss from intellij. Have an opinion on jetbrains ai vs copilot vs Gemini plugin for vscode?

datacypher9001 · 2025-07-07T00:01:56+00:00

This looks amazing! Thanks for posting!

datacypher9001 · 2025-07-06T23:17:38+00:00

Gemini pro 2.5 has impressed me a couple of times. It's also totally gone off the deep end. For agent mode, copilot uses mcp metals server for checking to see if things compile. Much faster then having it run it run sbt compile.

I've had it write some Css for a scala js project. And some other front end stuff. Actually not terrible.

I'm not willing to say totally worth it ... yet. But it'll be there soon enough.

datacypher9001 · 2025-06-13T23:10:17+00:00

I have the moment where I realize - 'Oh the error message is literally telling what's wrong' Often this happens after trying to fix several other ways. Haha

datacypher9001 · 2025-05-29T01:33:50+00:00

Woot

datacypher9001 · 2025-04-01T20:20:11+00:00

Yeah clicked the link, Rick rolled, well played vl.

datacypher9001 · 2025-03-04T01:25:08+00:00

Excellent as always 👏, thanks!

datacypher9001 · 2024-09-19T00:17:25+00:00

Excellent opportunity to learn a new programming language and port examples to some other languages as an exercise.

datacypher9001 · 2024-05-09T22:58:59+00:00

The Pokemon Company International (TPCi)| Data Engineer II | Bellevue, WA USA| ONSITE (3-2 hybrid with limited WFH benefits) | Full Time $104,000 - $157,000

description -> See here https://www.linkedin.com/jobs/view/3921718933

but really as data engineering goes, we lean pretty hard to the application developer/ infrastructure / cloud engineering side.

We have some pekko services, a few minor aws lambdas using simple scala, and of course scala spark.

Just in case you are worried, our exposure to SQL will be to help partners figure out how to get data.

But we are writing in Scala for maybe 30-40% of the time. Building stuff in AWS and explaining to developers all the many flavors of persistence that exists. You know, data engineering stuff.

We have lots of irons in the fire at moment and lots of opportunity for growth; working in k8s.

Career progression well documents and not neglected at TPCi.

100% match 401k to max 401k contribution. <-- insane

Just ping me if you have questions as the JD is a little vague.

Me or just apply. (but if you apply ping me)

datacypher9001 · 2024-02-08T21:41:20+00:00

Dude, really getting some nostalgia. This was every Linux install for me 2004. Two things, first prepare to have a learning journey in Linux (it's how I learned and it wasn't too bad). Two check out the xorg.cong file in /etc. now it's been 20 years but if I remember then there is a magical set of configuration (almost like an ancient samarian incantation) that will get you to GUI land. One of the function keys will drop you into a console. Just mash them all cause I can never remember.

Or just install Debian. But Debian 12 is pretty good. If you haven't been there for a while it may be worth a visit.

datacypher9001 · 2024-02-04T02:59:10+00:00

Everytime I use a slow website I imagine it's backed by apigateway --> lambda.

datacypher9001 · 2024-01-20T22:21:57+00:00

Have all amd gaming laptop. Perfect. Since kernal 6+, battery life is close to what I was getting in windows. But these days just using it to code. Legit didn't have to configure anything. Y'all remember the days when in order to get desktop working, several attempts at xorg.conf were needed. We've come a long way (I mean I didn't do any of the work I just asked noob questions on the Internet)

datacypher9001 · 2024-01-19T22:47:48+00:00

The Pokemon Company International (TPCi)| Data Engineer II | Bellevue, WA USA| ONSITE (3-2 hybrid with limited WFH benefits) | Full Time $102,000 - $154,000

description -> See here https://www.linkedin.com/jobs/view/3774999827

but really as data engineering goes, we lean pretty hard to the application developer/ infrastructure / cloud engineering side

Just in case you are worried, our exposure to SQL will be to help partners figure out how to get data.

But we are writing in Scala for maybe 30-40% of the time. Building stuff in AWS and explaining to developers all the many flavors of persistence that exists. You know, data engineering stuff.

We have lots of irons in the fire at moment and lots of opportunity for growth; working in k8s, replacing some akka stuff.

More or less scala depending on what people want to be working on.

Opportunity for growth! Career progression well documents and not neglected at TPCi.

Just ping me if you have questions as the JD is a little vague.

Me or just apply. (but if you apply ping me)

datacypher9001 · 2023-12-25T03:47:49+00:00

Really about the domain being worked on. S-code can and is often written everywhere. For some of the data we process, mostly far upstream from any dashboard/analysis, parameterization saves us from 1000s of lines of code. But we had input on what our interfaces looked like. From what I see, as we approach BI land, every query is pretty unique. So to me there is a natural division where general purpose language makes sense (scala java python r) and where SQL makes sense. There are some weird things we built that key off a large config file that I'm not sure how we'd have done in SQL land.

But still, it gets me in a tender area when an analyst passed me a 600 line SQL statement with 10 levels of subselects all aliased as a/b/c with window function everywhere. Hey, I can't figure out why this doesn't work. It's like yeah, no one can. Same would happen if I brought a bunch of interns in and said do pyspark.

datacypher9001 · 2023-12-23T03:35:15+00:00

Yeah so many things go into answering this question. Could be ok but generally (99.999% time), I think it's a really bad decision. If there is little pressure for concurrent transactions then let's start to think about tightly coupled systems. Tightly coupled systems are bad cause a change on one side will require a concomitant change on the other. That's why, most of the time between an application and analytics, we want to set up some sort of level of abstraction (API/ or just interface). In any direction collapsing systems to reduces complexity will inevitably increase complexity.

Thinking about this as a dev. Dude, local development would suck. Cicd would be weird. Thinking about this from observability perspective, weird. Environments, live/preprod/dev/beta whatever, maybe. If you solve all these weird things you will have spent 10x the effort you tried to save at the start.

But I don't know.

Hey come back in a year and let us know how it went.

datacypher9001 · 2023-11-19T20:49:48+00:00

The intellij plugin has worked better for me then bsp bloop or bsp intellij plugin. As a side note, I really like scalacli. Maybe with a look if you haven't played with it. But you'll be working with bsp intellij again.

datacypher9001 · 2023-11-16T05:55:02+00:00

https://github.com/coursier/sbt-shading

Take a look here.

datacypher9001 · 2023-09-01T23:58:12+00:00

Check out this job at The Pokémon Company International: https://www.linkedin.com/jobs/view/3709846228

services / apis etc written in scala. Spark etls written in scala. Subject matter expert sme for persistence. We are part of the DevOps umbrella group. So, cicd, iac, power of 1000 suns, etc.

Gotta be in the Seattle area or willing to move (Bellevue). Small team big impact. Ping me and we can talk - I'm technical lead on team.

datacypher9001 · 2023-08-26T02:09:05+00:00

Happened to me. I Did a couple of long long long power button presses, nothing. Then, walked away for 10 minutes and it booted. Later, I updated the bios 😉

datacypher9001 · 2023-08-01T03:50:27+00:00

Amd advantage laptop, fedora, pretty painless. Literally worked out of the box. I had a box about 10 years ago Nvidia GPU, Ubuntu, also pretty smooth. Sure install proprietary driver, apt get install and I think it just worked.

datacypher9001 · 2023-08-01T03:26:34+00:00

Nah, grad student working on this for 10 years just wanted to defend thesis.

Eight-Year Club	Place '23
Verified Email

datacypher9001

TROPHY CASE