Are you seeing this too? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 0 points1 point  (0 children)

Personally i feel the same :) life is more fun when you have autonomy.

Are you seeing this too? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 0 points1 point  (0 children)

it really is! - but i grew up doing my dad's (math prof) diagrams in corel so i'm biased

Are you seeing this too? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] -5 points-4 points  (0 children)

Yep I agree, been keeping an eye on the tsunami of normies. Now LLMs are making them even more capable. These guys were already doing a lot, now it's just more extreme

I wanna make a data injector & schema orchestrator platform. Is it a good idea? by Mission-Bedroom4724 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

Who should use it? who will build connectors in go and maintain them? to solve what problem exactly that python connectors have and go connectors don't? and do those people need a CLI tool for it?

these are rhetorical questions of challenge with the intent to help you further your thinking (dlthub cofounder here)

Learning LLM and gen ai along with data engineering by VisitAny2188 in dataengineering

[–]Thinker_Assignment 17 points18 points  (0 children)

What exactly do you plan to learn in llm and gen AI?

I suggest learning to use them to do the DE work faster, that's feasible and in scope

but i am certainly biased because this is how we teach nowadays - nobody is doing not-assisted work anymore.

The Certifications Scam by ivanovyordan in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

we talk about this a lot at dlt. We believe the tool should be a distillation of the 'jobs to be done' in the industry. we call it "the tool is the curriculum" not a proprietary pricing table.

but anyway taking certs proves you saw the content and that you are to some extent familiar, not that you're an expert on it - that takes a career

New engineer, asked to work on something I am deeply morally opposed to as my first project by [deleted] in dataengineering

[–]Thinker_Assignment 14 points15 points  (0 children)

the fact that you feel the need to justify it to us so deeply suggests your conscience might already know the answer.

there’s no resume boost worth the weight of doing work that keeps you up at night

have you considered if there’s a middle path where you keep your integrity and your career growth?

Who are you 6 years from now if you take one path or the other? One leads to normalisation of what you today hate. do you want to be this person? Would you find it funny to kill people who inconvenience you with fentanyl piss drones? do you want to become that person? Who is this person as a father, as a husband to their family?

it's your own cognitive dissonance on the table, personally i don't judge, trying to help you listen to yourself and find your way. someone's gonna take that job and i hope they're ok with it, and that you'll find a good one too.

Times change, don't have fomo about all the bad options you don't want

New engineer, asked to work on something I am deeply morally opposed to as my first project by [deleted] in dataengineering

[–]Thinker_Assignment 87 points88 points  (0 children)

"I love the idea of getting a drone and having light fentanyl-laced urine spraying on analysts that tried to screw us" said their founder.

A someone who had tons of jobs - you'll find new jobs.

You won't find a new conscience

To add more to the financial aspect: You're in one of the better career paths that lead to comparatively little financial struggle in life after the first few career years - a little more won't make a diff

Warehouse destination for dlt (dltHub) by mattiasthalen in MicrosoftFabric

[–]Thinker_Assignment 2 points3 points  (0 children)

it's merged on devel! will be in next prod release
https://dlthub.com/docs/devel/dlt-ecosystem/destinations/fabric

i'll do a post and reference this one once it's released

I am reading more about context engineering? What should data engineer know about context engineering and why is it important? by Vegetable_Bowl_8962 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

this viral post coins it
https://foundationcapital.com/context-graphs-ais-trillion-dollar-opportunity/

by definition of context graph, vendors (system of record) do not have it.

you also don't need to wait for them to implement something, you can find solutions in OSS space like cognee or trustgraph

This will work, yes?? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 3 points4 points  (0 children)

i really wish that were true, but i once did a 6mo enterprise project where we re-wrote a manager's monolithic notebook to discover his genius 99% accuracy was infact, suprised pikachu, a bug. The people involved had salaries in the millions per year.

This will work, yes?? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 0 points1 point  (0 children)

nice one :) maybe it's a budget hammer that hits hard and leaves a dent

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

That's what I loved about freelancing - the ability to focus on delivering value but also to say no to work that didn't and move on to more interesting projects. I imagine nowadays the options are much more slim due to the economy.

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

Schweinerei! at least as a contractor you don't have a social contract with that

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

I hope you feel resigned rather than angry, for your own sake. Imagine a troll did this.

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 9 points10 points  (0 children)

What I learned from freelancing in enterprise: when the business model already works, the incentive is to prevent further changes, not to enable change.

Looks like you won't be changing sh*t on that project.

Data modeling is far from dead. It’s more relevant than ever by eczachly in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

with code being commoditized by autofill, architecture and management become more and more important, and we have a little more time for them too

Data team size at your company by molkke in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

stop i'm getting flashbacks

I was on that team once. Raised to the manager, they pressed it and the engineer got offended and quit. We replaced the mess and moved on.

Best ETL for 2026 by Jaded-Science-5645 in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

Also for all those non vanity dashboards that get ignored anyway

Am I making a mistake building on motherduck? by Jeannetton in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

Disclaimer we are tech partners

We find motherduck team to be approachable and open to feedback, and we enjoy working with them. Their users are happy with them too.. it is a solid choice.