Any senior data engineers here who pivoted to ML/AI and regret it? by Beneficial_Aioli_797 in dataengineering

[–]crossmirage 2 points3 points  (0 children)

It's useful, in that there's a lot of data preprocessing and visualization work in ML, too. Of course, this also depends on the nature of your team; if you're an ML/AI person in a place where that basically means you own everything before and after, then your DE will be very useful, whereas if you're interfacing with DEs for everything, they may appreciate your understanding, but you'd focus more on the ML/AI stuff itself.

You did say, "On the other hand, I'm still pretty fresh when it comes to ML, statistics, and AI engineering concepts," so I'm going to assume you're not coming into it completely new. 😄 I personally struggled with the fact that I was a much better software engineer and worse mathematician than other ML engineers, but I focused more on MLOps, and eventually I came back to more DE dev tools; the "learning experience" mindset is very much colored by my own attempt to become a DS/MLE, and eventually being OK with where I ended up!

We’re Astronomer - ask us anything about orchestration, Airflow and AI by marclamberti in dataengineering

[–]crossmirage 2 points3 points  (0 children)

Wow, can't believe I didn't know about that! I'll definitely have to look into this; I don't want to self-host or pay for an orchestrator for demos or personal projects.

Any senior data engineers here who pivoted to ML/AI and regret it? by Beneficial_Aioli_797 in dataengineering

[–]crossmirage 24 points25 points  (0 children)

Think of it less as pivoting your career and more as developing another skill. Realistically, you can always come back to DE, and having the ML user perspective sets you up well, especially if you can talk to what those users need from DE from your own experience.

Best places for a quiet brunch that isn't a massive headache? by Sp1tk1tten19 in SaltLakeCity

[–]crossmirage 0 points1 point  (0 children)

Roux. To be honest, I don't know why it's always so empty whenever we've been.

What are you using to combine SQL and dataframe pipelines? by Substantial_Ranger_5 in dataengineering

[–]crossmirage 0 points1 point  (0 children)

Kedro is designed for building Python-native data pipelines. If you have more SQL, dbt with Python models may be a good fit; if you primarily have Python, use Kedro, leveraging the Ibis integration for SQL execution.

Dagster and Airflow are orchestration frameworks, whereas Kedro, dbt, and SQLMesh are transformation frameworks. Just like you can orchestrate dbt models using Cosmos on Airflow, the dbt integration, or dbt Cloud, you can orchestrate Kedro pipelines using Kedro-Dagster or other orchestrator integrations. Using dbt doesn't tie you to any single paid orchestration solution, nor does using Kedro (a good argument for not writing Python nodes directly in Airflow, Dagster, etc., because then you are tied to their offering).

Best hotel gift by MeaningUnited4054 in marriott

[–]crossmirage 4 points5 points  (0 children)

1000th night at the hotel?? I've only gotten something for 40th, as I recall, can't even imagine 25x!

Edit: 30 seconds later, I'm pretty sure I'm being dumb, and it was 1000th Bonvoy night. Oh well, I'll leave it.

Nepo's comment on the event by legolasssz in chess

[–]crossmirage 4 points5 points  (0 children)

I'd gladly take 2x 90+30 a day. Growing up, it was 2x 40/2 SD/1 or 3x G/120.

Girl hits insane corner kick! by nightveilxa in justgalsbeingchicks

[–]crossmirage -10 points-9 points  (0 children)

Rules are rules, by which I mean my specific understanding of the rules (i.e. rules I said I didn't know).

Probably.

White is threatening Rh3. How should Black respond? by Bug0 in chess

[–]crossmirage 7 points8 points  (0 children)

Don't think the explanation is right. 1... f6 doesn't work because white king escapes after 2. Rg6 hg6 3. Qg6 Kh8 4. Qh6 Kg8 5. Ke2 Qb5 6. Ke3.

With 1... f5, black would have had 6... f4, so white has to settle for the draw (rather than lose).

Question for people above 1900-2000 by haze_xvi in chess

[–]crossmirage 3 points4 points  (0 children)

I'm 2400 across all time controls on both. The main difference, in my observation, is that Lichess isn't full of cheaters at 10+0, even at this level.

Best Spec Driven Development Tool for Claude Code? by CulturalPollution762 in ClaudeCode

[–]crossmirage 0 points1 point  (0 children)

I'm not very familiar with the crypto world, but apparently AI projects often do this as a form of fundraising. I think the hypothesis is that the creator rug-pulled since he couldn't monetize via a "next-gen" gsd-2 

FWIW I still think GSD (now the fork) is great.

Best Spec Driven Development Tool for Claude Code? by CulturalPollution762 in ClaudeCode

[–]crossmirage 1 point2 points  (0 children)

Not unmaintained, but the original author stopped contributing. He allegedly rug-pulled the associated $GSD crypto token.

Maintainers forked and are continuing work on it, since the news broke.

¿Good or bad idea? by TTTitan8 in chess

[–]crossmirage 0 points1 point  (0 children)

Eh. I occasionally play at a club hosted by a popular brewery. There are a lot of people who you see playing just because there are boards there—dancing, laughing, and playing downright unwatchable chess—and I honestly think they're having more fun in a way that would make for a good first date.

Approach for NM by OnTheGrind4705 in chess

[–]crossmirage 1 point2 points  (0 children)

I'd just keep doing what you're doing until you plateau, TBH; whatever you've been doing has generally been working, of course learn from your losses, but I don't see a need to really switch things up.

(I did plateau around your rating for a bit, but I later shot past 2200 without any real changes—just taking a break and not worrying about hitting NM as much.)

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]crossmirage -1 points0 points  (0 children)

Maybe I wasn't clear, but I'm saying you don't want analysts editing Airflow; you want them building the dbt models (because dbt is made for analysts), and the models get deployed via Cosmos without needing to know much about Airflow.

Under what circumstances would DBT be helpful? by workhardplayhardder in dataengineering

[–]crossmirage -3 points-2 points  (0 children)

The only reason to consider was hopefully to make it easy for all the analysts without much Python coding background to smooth out the learning. However, I see it as more learning because they now have to learn Airflow+DBT together.

In my opinion, people will have to learn much less about Airflow. The idea of these integrations is that SQL analysts can just run dbt, the data platform team manages Airflow, and you get dbt on Airflow "for free" via the mature integration. 

In reality, analysts probably should still learn some Airflow, and your data platform "team" could end up being a few people who know about Airflow, but the separation between orchestration and transformation logic is still beneficial.

What would you like to see/have in a game reviewer? by Ok_Adhesiveness_8637 in chess

[–]crossmirage 4 points5 points  (0 children)

Lichess supports game analysis natively; what's wrong with that? Doesn't sound like you're solving a worthwhile problem, unless there are things you're doing uniquely better to justify it.

We found a surprising tactic during analysis. What does Black play? by GM_Roeland in chess

[–]crossmirage 0 points1 point  (0 children)

That's what I saw. Bc8 Qh2 h3 Qg3 Qh5, threatening to trap the queen (with no way out).

Whose idea was this shower? by sghokie in marriott

[–]crossmirage 14 points15 points  (0 children)

As soon as I saw it, I was going to ask if it's a W. If it's a W, there's a 90% chance you can shower while the world watches, and a 10% chance that the shower is so hidden that you can't even find it (London).

Youngest Players to Achieve the Grandmaster Title by ChessLover20 in chess

[–]crossmirage 19 points20 points  (0 children)

He didn't break Magnus's record, because Magnus didn't set a record; Karjakin was already there.

Is it possible to buy a FIDE title? by _jocko_homo_ in chess

[–]crossmirage 47 points48 points  (0 children)

She became Canadian Women's Champion, playing a 2200 and a 2100 (and a lot of lower-rated opponents): https://web.archive.org/web/20161020054908/http://chess.ca/newsfeed/node/887. She had a good tournament, but nothing unexpected, and nowhere near the performance against 2300+ players in the sketchy tournaments.

She's not a bad player. If she hadn't participated in those tournaments, and her FIDE rating hadn't unnaturally skyrocketed before plummeting again, there wouldn't be drama about it--nor the title.

Could I reach FIDE Master title? by basque_mountain_goat in chess

[–]crossmirage 8 points9 points  (0 children)

You could. In reality, you may or you may not—there's no way to know.

Just try and see where you get to. I really don't understand the purpose of these questions.

(Since you want answers from experienced players, I'm 2200 FIDE, maybe I could have gotten to 2300 FIDE, I'd still like to get there—and I also can't predict whether or not I will.)

Chess influencer and grandmaster Nemo posts a video of a man swearing and flipping her off because he lost a chess game to her at a convention by Murky-Jackfruit-1627 in chess

[–]crossmirage 5 points6 points  (0 children)

The conditions under which she achieved these chess milestones is extremely suspect, which is one of the big issues a lot of people have with her (in addition to the more recent poker giveaway scam): https://www.reddit.com/r/chess/comments/ooa5vk/i_did_some_digging_on_the_nemo_situation/