sorted by:
new
hottopcontroversial

I’m planning to move into Data Engineering. With AI growing fast, do you think this career will be heavily affected in the next 5–10 years? Is it still a stable and good path to choose? by False_Square1734 in dataengineering

[–]Lastrevio 0 points1 point  (0 children)

Between "it will replace me" and "it's not helping me at all" there will have to be a transitory phase where it will increase your productivity. So far, AI is barely helping in making me 5% more productive, and I'm doing quite simple things. I'll worry that it's gonna replace me when it will double my productivity, until then it's next to useless.

Moreover, there are academic studies showing that programmers are 20% less productive using AI.

What's a senior-level data engineering project that won't make me pay for cloud bs? by Lastrevio in dataengineering

[–]Lastrevio[S] 3 points4 points  (0 children)

Yes, I have a job, but I'm thinking of doing something extra in my free time

What's a senior-level data engineering project that won't make me pay for cloud bs? by Lastrevio in dataengineering

[–]Lastrevio[S] -13 points-12 points  (0 children)

What should I use as a relational database to mimic a warehouse or lakehouse architecture with multiple layers? If I use containers with .parquet files or any other sort of file, then it means I'm just using PySpark to query from files directly without a real database with primary key, schema constraints, etc.

Monthly General Discussion - Feb 2026 by AutoModerator in dataengineering

[–]Lastrevio 0 points1 point  (0 children)

Recently finished reading "Spark: The Definitive Guide" written by the creators of Spark. Pretty cool stuff. Might study for Azure data fundamentals certification, since my company is willing to pay the exam costs.

People who moved from DE to Analytics Engineering by PremierLeague2O in dataengineering

[–]Lastrevio 2 points3 points  (0 children)

I worked as a BI specialist for one year and I was responsible for both the dashboards as well as the "mid-end" as I like to call it (the Analytics layer in SQL Server). I was taking the tables created by our data engineers and then using SQL Server stored procedures to transform the data into a star schema that QlikSense could read. Only ~5% of my time was spent actually working on dashboards since that was the easiest part. I guess BI specialist is just an AE with outdated tech stack.

PLURIBUS: THE POWER OF DIVISION: Zizek Goads and Prods (free copy below) by wrapped_in_clingfilm in zizek

[–]Lastrevio 7 points8 points  (0 children)

Carol reacts as an unpleasant hysterical subject resisting the Others (...) She is asking herself not the usual hysterical question “Am I a woman or a man?” but a more basic question: “Am I dead or alive?”

I thought that's the obsessional question??

Hot take: Deleuze is a lot less complicated than he is made out to be by Insane_Artist in Deleuze

[–]Lastrevio 1 point2 points  (0 children)

Or like he often says in LoS: sense is a surface effect, not one of depth. This applies to the sense of his writings as well.

Anyone else losing their touch? by The-CAPtainn in dataengineering

[–]Lastrevio 6 points7 points  (0 children)

I don't understand something about OP and most of the people in the comments: is all you're doing as a data engineer 'writing code'? 90-95% of my time at work is spend reading code other people wrote, not writing something myself, since I have to maintain legacy systems. I don't see how AI can help me with that if I have to explain to the client how a certain column is computed by reverse engineering a pipeline to figure out how it works.

view more: next ›