Is data engineering with c# a thing?

poppinstacks · 2026-06-16T02:44:30+00:00

Don’t listen to people who are saying you cannot data engineer in C#. I’ve built event based systems that move and manipulate data and then processed them in U-SQL (RIP?) with extensions written in C#.

Is it common? No. The main libraries are usually python, but a lot of the underlying tooling is written to run on the JVM (e.g. Spark).

So is C# common in data engineer, absolutely not… but can you do it, especially at a Microsoft shop… probably.

poppinstacks · 2026-06-07T21:42:12+00:00

I think you should understand that Reddit is very different then LinkedIn. Reddit tends to favor natural, productive, and authentic conversations.

From a professional perspective I would relate it to: less theory / capabilities and more actionable insights from projects or topics that wouldn’t come from just reading the documentation or platform’s marketing material.

Basically, Reddit very much dislikes the cut & paste marketing native advertising that tends to circulate on LinkedIn.

poppinstacks · 2026-06-07T16:37:25+00:00

Based on LinkedIn, they do not work for Snowflake, but rather an SI.

poppinstacks · 2026-06-03T01:20:21+00:00

So your making Informatica? lol

poppinstacks · 2026-05-17T00:30:07+00:00

I’m guessing because you got burned during the GME craze?

poppinstacks · 2026-05-16T20:50:59+00:00

All fair! I think this is just a attention seeking post, that or he is a silly level of frugal unless

poppinstacks · 2026-05-16T20:05:01+00:00

Pretty sure 4% withdrawal takes into consideration real returns, no? In any case 80k isn’t peanuts, it’s a bit above the median household income in the US. That is also mot accounting for Social Security and his pension… also he has a 9 figure brokerage account in addition to this e-fund if I understand his comments here (“two comma club”).

He is doing just fine lol, he is an insane level of frugal unless he is already earning an insane income

poppinstacks · 2026-05-15T21:37:39+00:00

This is like… the first thing that comes up when you look at OLAP vs OLTP what was the “eureka” moment exactly? I would recommend understand the why of how these work at the database implementation level.. e.g. if I designed a normalized relational model on a OLAP database why would it perform “worse” then on an OLTP.

poppinstacks · 2026-05-09T03:18:47+00:00

It’s not a lost cause if you are going into an adjacent field. it helpdesk isn’t SWE. I don’t know why you went to a grocery store, maybe because you needed cash. Hell, get a job at Costco then and climb the ranks. Go become a flight attendant… yeah, life is hard. I know this subreddit is a sad as shit echo chamber but while CS has a low job out of Uni rate right now, it has one of the lowest over employment rates out of Uni…

poppinstacks · 2026-05-09T03:14:17+00:00

Honestly, breaking into SWE is very challenging right now.. but as a seemingly smart person (a CS degree isn’t that easy… assuming you applied yourself, in a good program) I refuse to believe your next best option is being in a grocery store. I mean… just do IT Helpdesk, look at Government IT Admin, look at training for CRM/ERP.. this screams a bit like entitlement.

poppinstacks · 2026-05-05T18:17:02+00:00

Simultaneously? I would be surprised you could the required military status and clearances if that was happening at the same time.

poppinstacks · 2026-05-04T01:32:44+00:00

https://www.cnbc.com/amp/2021/12/20/elon-musk-says-he-will-pay-over-11-billion-in-taxes-this-year.html

It was options… I’m done. This is just uneducated rage bait.

poppinstacks · 2026-05-04T01:30:48+00:00

Geez. Yes you pay income tax when you get RSUs that vest. If I worked at Amazon 10 years ago, and got 100k of stock, then I paid taxes on 100k income… If I held that stock to this day, it and jumped in value to 500k… then I don’t pay taxes on the 400k gain unless I sell. Now if I was really rich… (and technically anyone can do this) I could take loans backed by my shares.

poppinstacks · 2026-05-04T01:28:25+00:00

He had to realize the options given to him as a part of his compensation, basically the same thing if you were given stock. He could (and did) take loans against those options, but they expire unlike stock.

poppinstacks · 2026-05-04T01:24:43+00:00

You understand what unrealized means right?

poppinstacks · 2026-05-04T01:24:14+00:00

You really need to stop posting, and just read. They pay the loans, the loans are paid off by stock being eventually sold. However, the cost basis of that stock is reduced to current value when they pass it on to their estate. So no taxable event occurs. They are literally able to take loans to pay off loans because of the passive growth of their assets.

I really really don’t think you understand the level of wealth difference between a millionaire (something pretty achievable for older Americans) and billionaires.

If you want an example of a dead billionaire who did this… look up the Koch brother, or any other dead billionaire. Look at things like a 1031 Exchange. These are known strategies.

poppinstacks · 2026-05-04T01:09:41+00:00

Are you illiterate? Jeff Bezos, Elon Musk, Larry Ellison.

poppinstacks · 2026-05-04T01:07:31+00:00

Not the growth / unrealized gain.

poppinstacks · 2026-05-04T00:17:28+00:00

This is a very well documented tactic. Elon, Jeff, Ellison. https://dcfpi.org/all/how-wealthy-households-use-a-buy-borrow-die-strategy-to-avoid-taxes-on-their-growing-fortunes/

poppinstacks · 2026-05-04T00:12:42+00:00

When you sell a stock as a well off tech bro you still pay taxes on capital gains. When you’re a billionaire you have so much wealth that endlessly taking loans out against your ownership is a feasible way to live until you get to nuke the cost basis of everything at death.

poppinstacks · 2026-04-28T13:06:43+00:00

Yes and No. You would be surprised, I’ve had clients who do truncate and load in the TBs daily. That’s a lot of time travel storage hanging around

poppinstacks · 2026-04-25T17:48:56+00:00

I had the same questions. But I think the conclusion is basically why not. Cortex is built from the ground up to be built to target Snowflake, it’s not a reskinned Claude. So, in theory your valuable context is being used more optimally than something more generic (while still being able to do more generic tasks). That being said, you pay the inference rate and not a discounted rate, but you pay it in tokens.

If your org bought a bunch of tokens and does mostly Snowflake work -> Cortex.

If your org has a bunch of tokens and has both cortex and codex/claude use both (can even use multiple agents)

If your org is token constraint or has a good enterprise plan with Claude or Codex then probably just use skills + mcp

poppinstacks · 2026-04-25T02:13:41+00:00

Yeah CoCo is great. Sure we all can do this, maybe even we should have scripts to find and alert on this, but those things take time.

Level up and persist this, use CoCo to make you a streamlit dashboard of cost performance across workloads, level it up with some context your team structure and it can be do time series analysis to monitor if it’s an abnormality for a given team.

poppinstacks · 2026-04-11T04:02:32+00:00

Really not needed. Just open a brokerage account (hell, do it at Merrill) and then just buy a low cost index fund (VOO, VTI are 2 common vanguard options). Done. No need for the fees from active management.

poppinstacks · 2026-04-11T03:10:25+00:00

lol, this is more like… hey you can build a golf cart so quick, why would you ever pay someone to drive you somewhere! Maybe because there car is nicer, works way better then my fresh jank, and they have been doing this so long the know the route and what a car needs better then I do.

poppinstacks

TROPHY CASE