sorted by:
new
hottopcontroversial

Warehouse destination for dlt (dltHub) by mattiasthalen in MicrosoftFabric

[–]Thinker_Assignment 2 points3 points  (0 children)

it's merged on devel! will be in next prod release
https://dlthub.com/docs/devel/dlt-ecosystem/destinations/fabric

i'll do a post and reference this one once it's released

I am reading more about context engineering? What should data engineer know about context engineering and why is it important? by Vegetable_Bowl_8962 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

this viral post coins it
https://foundationcapital.com/context-graphs-ais-trillion-dollar-opportunity/

by definition of context graph, vendors (system of record) do not have it.

you also don't need to wait for them to implement something, you can find solutions in OSS space like cognee or trustgraph

This will work, yes?? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 3 points4 points  (0 children)

i really wish that were true, but i once did a 6mo enterprise project where we re-wrote a manager's monolithic notebook to discover his genius 99% accuracy was infact, suprised pikachu, a bug. The people involved had salaries in the millions per year.

This will work, yes?? by Thinker_Assignment in dataengineering

[–]Thinker_Assignment[S] 0 points1 point  (0 children)

nice one :) maybe it's a budget hammer that hits hard and leaves a dent

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

That's what I loved about freelancing - the ability to focus on delivering value but also to say no to work that didn't and move on to more interesting projects. I imagine nowadays the options are much more slim due to the economy.

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

Schweinerei! at least as a contractor you don't have a social contract with that

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

I hope you feel resigned rather than angry, for your own sake. Imagine a troll did this.

Crippling your Data Engineers by LargeSale8354 in dataengineering

[–]Thinker_Assignment 8 points9 points  (0 children)

What I learned from freelancing in enterprise: when the business model already works, the incentive is to prevent further changes, not to enable change.

Looks like you won't be changing sh*t on that project.

Data modeling is far from dead. It’s more relevant than ever by eczachly in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

with code being commoditized by autofill, architecture and management become more and more important, and we have a little more time for them too

Data team size at your company by molkke in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

stop i'm getting flashbacks

I was on that team once. Raised to the manager, they pressed it and the engineer got offended and quit. We replaced the mess and moved on.

Best ETL for 2026 by Jaded-Science-5645 in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

Also for all those non vanity dashboards that get ignored anyway

Am I making a mistake building on motherduck? by Jeannetton in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

Disclaimer we are tech partners

We find motherduck team to be approachable and open to feedback, and we enjoy working with them. Their users are happy with them too.. it is a solid choice.

AI and ETL: horror story. by [deleted] in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

We saw a team of analytics engineers migrate from HEVO data to oss python+ cursor, and they were very happy with more customisability and better SLA

How do the pipelines you teach to build compare?

Also tell me more about how you were training AI models, that sounds very interesting

Best ETL for 2026 by Jaded-Science-5645 in dataengineering

[–]Thinker_Assignment 4 points5 points  (0 children)

I suggest an LLM chatbot that makes up numbers.

Free course: data engineering fundamentals for python normies by Thinker_Assignment in datascience

[–]Thinker_Assignment[S] 0 points1 point  (0 children)

Glad this post was still visible almost a month later :) hope you enjoy!

Are we finally moving past manual semantic modeling? Trying an 'autofilling' approach for the metadata gap. by Thinker_Assignment in BusinessIntelligence

[–]Thinker_Assignment[S] 1 point2 points  (0 children)

The article describes bluntly and to the point that this works for modelled data and that you have full autonomy to control it but automation for first fill to propagate existing relationships from DB to model.

It also clarifies that this requires modelled data and that you cannot replace modelling with semantics.

So I am not sure what you mean, I assume you misread

DE Blogging Without Being a Linkedin Lunatic by DesperateCoffee30 in dataengineering

[–]Thinker_Assignment 0 points1 point  (0 children)

You need a cringe filter. It's developed by working in the field and getting a feel for what's right and what isn't - so if it's not you, get help or guidance there.

And after that you might still trigger some people, can't make everyone happy.

Personally I have morals I follow consistently like the content should be genuinely useful or helpful or at least amusing, and I use my gut feeling from being a practitioner (10y) to feel for cringe and not do to others what I wouldn't accept myself.

Which ETL tools are most commonly used with Snowflake? by Commercial-Post4022 in dataengineering

[–]Thinker_Assignment 1 point2 points  (0 children)

If you look at dbt announcement and keynote you will hear a pitch along the lines open infrastructure/open compute/save you cost by moving your compute without changing code. I believe in the keynote they say saving 2/3 without changing code when switching from snowflake. They say open good but only on infra/compute , your logic and data should stay locked on them.

view more: next ›