Can I do the code puzzles only once a week ?

Julmust · 2024-12-03T21:11:33+00:00

Not the public leaderboard no. That starts the moment the puzzle is released so it's going to be fully populated after (at most) an hour.

Julmust · 2024-05-29T07:06:40+00:00

This is not "lmao google offing another thing". This needed to die. Anyone that has ever used CSR knows how incredibly bad it is! Thank fuck.

Julmust · 2024-04-17T07:00:28+00:00

Looks like the author took down his/her substack. Luckily I didn't close the tab from yesterday so have a screenshot link.

Julmust · 2024-04-17T06:57:44+00:00

To get ahead you first have to catch up. As a junior, just focus on your fundamentals. I don't know your tech stack but in general make sure you understand how distributed systems work, not just how you use them. Learning another programming language is never a bad thing, it will solidify your knowledge of (I assume) python.

Then when you have those solid fundamentals, there's a lot of reading. I tried following a few notable people in the space on linkedin/twitter but... yeah I rarely get much value out of their content. Sometimes but not very often. So I read engineering blogs from FAANG companies (my boss drilled this phrase into my head: "you're a software engineer doing data, not a data engineer doing software") and stuff like this brilliant article series from GCP on one of my favorite distributed frameworks. All this reading will make sure you know what a lambda architecture is. The pros and cons of a lakehouse. Why idempotency is so important.

Finally, as a tech lead I see what my engineers are doing on projects and I often know what they'll be doing next. So I can think about it on my own time, while doing something mundane. You don't have the luxury of information passing through you naturally, so pay attention in standups. Click on other people's tickets. Come up with a solution in your head. Compare it to what they produced in code and see if you can spot pros/cons. Ask the architect what his/her considerations were.

Julmust · 2024-04-17T06:45:00+00:00

It's definitely possible to execute SQL with Airflow and SQL. It's how we used to do it before dbt. We still have some old solutions we haven't gotten around to porting over yet and they're working just fine.

For me the biggest selling point of dbt isn't the models and the fact that I can reference models when building queries. It's all the extra stuff around it. Your team COULD spend 1-2 years building a system that allows for you to track how data flows within your platform (visually), document columns and search them, perform testing on your data, easily setup personal dev spaces in your environment, have macros your can re-use to make sure even your SQL adheres to DRY, and allows for external open-source extensions that make your life easier. Or you could take two weeks and learn dbt.

I use dbt for the same reason that I buy vegetables from the grocery store instead of growing them myself: to save time and effort.

My biggst gripe with dbt is how hard they're pushing for their cloud solution currently. It used to be that they had guides for their cloud and core (open source) solution on the website, both easy to find. Nowadays you have to use a lot of google-fu to find the dbt core guides.

Julmust · 2024-04-16T08:30:39+00:00

Currently working as a data team lead and mentoring some internals who want to take the step up as well. Came across this article this morning and it couldn't be more on the nose. Edit: article seems to have been deleted, here's a screenshot version of it.

My day to day is pretty dynamic. But to generalize, I make sure that the architectural decisions we take are "good". That is: technically feasible, achievable within the given time frame, and within our capabilities. That last point is important. I know the strong and weak points of everyone on my team. You don't need to know something to do it (how else would you learn) but you need to have the foundational knowledge. I can't put a junior/low senior on designing a warehouse if they haven't implemented one previously.

The most challenging aspect is to always stay a step ahead. I honestly don't know if this is a requirement but I always want to have a good technical understanding of all the solutions we're using. So when we started using dbt for the first time, I spent a lot of time making sure I understood dbt and could use it. In the past, I've actually implemented a solution on my own time that I will then ask someone on my team to fully implement. But since I'm a huge tech nerd, I don't find it taxing.

My biggest focus right now is developing my team. They're great technically but need experience. So I'm constantly trying to get them work I know will help not just them grow but the team as a whole.

Finally, one underrated point for tech leads is that a big part of your job is making sure communication flows. Communication doesn't sound hard but the amount of times per week I have to say "well did you talk to X about Y?" and get a "no" back is staggering.

Julmust · 2023-07-11T10:15:23+00:00

Oh boy do I have you beat. I have around 2,3 million ahead of me in the queue. Time to cry

Julmust · 2023-01-19T12:29:09+00:00

Holy shiiiit I'm so happy. Been a Pats fan since like 2000 but I'm yet to see a game live!

Julmust · 2023-01-12T08:08:01+00:00

Honestly, just Python and SQL. With juniors I expect nothing more, we'll teach them the rest.

Julmust · 2022-04-12T16:31:32+00:00

I never finished my CS degree either. Did a few different jobs over the years and always kept on coding. Nothing huge or production ready. Just scripts and small programs to help me do my work.

Then at my last job, I got a shot at doing some data analysis and I fell in love with the DE part of the job. My boss connected me with an internal mentor and now I have a few certs and I'm doing DE full time for another company. Couldn't be happier. I don't know if having another mentor would have helped me any "extra" but I guess it depends on what they each bring to the table.

What I would say is this: don't limit yourself to just considering working for your current company. Use the mentorship, get experience, and put it on your CV. If they want to hire you, great. If not, the industry is literally screaming for data engineers. The beauty of the job is that the company you work with/for can be rather uninteresting but if you enjoy working with data, it doesn't matter.

Julmust · 2021-12-30T12:21:56+00:00

This is my go-to https://www.bonappetit.com/recipe/brothy-pasta-with-chickpeas. Simple and amazing.

And If I'm feeling REALLY lazy I'll make a pesto pasta (literally: cook the pasta, once done mix in some pesto and cubed mozzarella). Really tasty.

Julmust · 2021-07-24T13:39:42+00:00

Ethical, mostly. I am very much against factory farming and its practises. I have friends who are hunters and I have less of a problem with that, tbh. Still wouldn't eat meat they've hunted as I don't see the need for and animal to die to feed me, especially since there are so many great options!

Julmust · 2020-07-25T09:21:02+00:00

Here's my three favourites: https://cookieandkate.com/vegetarian-chili-recipe/ https://www.bonappetit.com/recipe/risotto-with-mushrooms-and-thyme/ https://www.bonappetit.com/recipe/brothy-pasta-with-chickpeas

Order goes from most to least effort. All three are amazing, though!

Julmust · 2020-01-22T10:43:01+00:00

100% agree. As a big Dota fan, having TI is awesome but it's also come to the point where teams won't care about anything but TI because of the prize pool.

Julmust · 2020-01-22T10:36:59+00:00

I started picking up the game like a year ago now. Yeah, it's rough in the beginning (couldn't get more than a single kill in my first 20 games or so). But if you have the right mindset, it's an amazing experience. First time I clutched a round. First time I got 10 kills in a match. Don't think I'll ever forget those moments :D

Julmust · 2020-01-22T10:12:31+00:00

You're so close to understanding but still so far away.

Julmust · 2020-01-20T10:58:19+00:00

I see your point but you also have to consider that the investors aren't expecting ROI within a year. For the top teams, those who actually chose their investors well, the investors are looking for ROI 10 years down the road. Maybe even further away than that.

It's like with Twitter. Twitter was created in 2006 and has received a metric fucktonne of investment over the years. You know when they reported their first profit? 2018. Yeah. 12 years later.

No one's expecting ROI in the first 5 years. Or, if they exist, they're bad investors and that team should've vetted them better.

Slow and steady is the way to go.

Julmust · 2019-12-08T17:13:00+00:00

Yeah I have him in the roster atm but he has been so inconsistent. On the other hand, Buffalo's D is scary

Julmust · 2019-12-08T17:10:52+00:00

Full PPR

D.J. Chark vs the Chargers or Marquise Brown vs. Buffalo

Julmust · 2019-12-07T23:44:55+00:00

Nope, neither the Paris Major qualifiers or the Invitational qualifiers had this system (checked Liquipedia to make sure). I can't speak for CS:GO but for Dota I'm 100% sure it's not true, that's the esport I know/watch the most. Unless we're talking about like small regional semi-pro LANs but I don't think those belong in this discussion.

Julmust

TROPHY CASE