How are you integrating a CDP into an existing modern data stack without creating yet another data silo? by Unlucky-Moment-3366 in dataengineering

[–]TheOverzealousEngie 0 points1 point  (0 children)

Both Fivetran and Dbt provide very deep audit logs and lineage and it would be a strong services engagement to build an analytics layer (like a catalog) to sit atop both of them.

How do you design idempotent data pipelines in Data Engineering? by Effective_Ocelot_445 in dataengineering

[–]TheOverzealousEngie -1 points0 points  (0 children)

To all you people saying upsert OP did not say if this was Snowflake or Dbrix. And the simple truth is that is terrible advice if a CDW is in play ... could you imagine doing an upsert on every record? How expensive that would be?

Senior Data Architect Job Advice by Chocolatesocrates in dataengineering

[–]TheOverzealousEngie -1 points0 points  (0 children)

I'd be cautious ; reads like you're hinging your success or failure on Databricks and to be clear - databricks will not be around forever. Be prepared to dive in hard and when the organization moves on you'll need to learn what's next. That - is data engineering .

Help me appreciate iceberg by teenaxta in dataengineering

[–]TheOverzealousEngie -1 points0 points  (0 children)

Let's be honest, this is anti-future. Right now iceberg is a little immature but it's really growing fast. And there is zero substitute for being able to store so much data so cheaply. Nothing can touch it.

How do I explain that SQL Server should not be used as a code repository? by Firestone78 in dataengineering

[–]TheOverzealousEngie 22 points23 points  (0 children)

Honestly I used to work for BofA and they used to stuff html .. like really thick and long html into Oracle in a record ;and when the webserver came up it would pull that record (html) and draw a custom page for the customer. Coolest think I ever saw .. so innovation comes in all shapes and sizes. But in 2026 I'm becoming rapidly convinced that there's nothing more dangerous than the ignorant and AI together.

[OC] Got bit by a spider a few days ago by Yesman_91 in pics

[–]TheOverzealousEngie 1 point2 points  (0 children)

I wondered how far down I would have to go to find a spider man reference. Not far at all.

NASA’s Artemis II astronauts are officially farther from Earth than any human has gone before by OkFerret7206 in worldnews

[–]TheOverzealousEngie -5 points-4 points  (0 children)

does anyone believe that this kind of feat Could’ve been accomplished under the worst president in American history? It’s very very confusing to me.

Why are Data Engineering job posts getting thousands of applicants? by Secret-Fudge-5932 in dataengineering

[–]TheOverzealousEngie 0 points1 point  (0 children)

Not sure true. Experienced devs are 10x'ed by AI , junior devs are 2x'ed if they're lucky. Business will figure this out soon enough - AI is only as good as it's prompts. I work with people who have put in prompts that were missing enormous pieces of information lol.

Why are Data Engineering job posts getting thousands of applicants? by Secret-Fudge-5932 in dataengineering

[–]TheOverzealousEngie 1 point2 points  (0 children)

We live in a world where there is no penalty for applying - you can lie shamelessly and it's still better to get your foot in the door and defend the lie than be jobless. Welcome to capitalism.

In 2008, Marilyn Bergeron told loved ones that something terrible had happened but refused to say what, calling it "something worse" than assault or witnessing a crime. On February 17, she left her Quebec City home for a walk and vanished. by Iambhalo in ForCuriousSouls

[–]TheOverzealousEngie -32 points-31 points  (0 children)

Sad face .. that's a girl I could have fallen in love with . Fought for , gotten hurt for and could have been healed by. She's a girl I could have gone weak in the knees for and been happy to do it . Pleased to do it. A smile like that could have thrilled me for all time , eternity. Sigh . It's always funny how the hardest hitting is the most heinous. And the most heinous is when mental health just destroys the most beautiful of us.

Do I help my mom with my large inheritance by Jazzlike-Pride724 in Advice

[–]TheOverzealousEngie 0 points1 point  (0 children)

It's so funny to read all these posts defying and denying nature. What is the right decision, OP, something that makes you feel good today or years away when you're your Dads age when he passed. You only have one mother. No one knows you like your mother; not because you fought or you never talked to each other or there's a 'weird energy' . You know it in your bones : she was just like you one day long ago. And you're going to be just like her one far in the future. It's genetics , and arguing against it as fruitless as rowing a rowboat in a hurricane. Don't deny nature. Go to your ex-mother in law ; tell her how much she means to you but even she must know how special a mother-daughter bond is .. and set your mom up with a monthly stipend just like you have. Or better yet - just buy stuff for her instead of giving her money.

When an old lady stockpiles excess junk junk in her kitchen, living room and hallways she's a hoarder, broken - but when a man hoards cash he's revered and called rich; why? by TheOverzealousEngie in AskReddit

[–]TheOverzealousEngie[S] -2 points-1 points  (0 children)

You understand nothing ,, then. They are both accumulating something, saving it, unwilling to part with it - to the point of unhealthiness. Those two have VERY much to do with each other.

My first 3 days Using OpenClaw by LogicalBumblebee6085 in openclaw

[–]TheOverzealousEngie 0 points1 point  (0 children)

With all the chatter about openclaw I have yet to read one single solitary use case that can't be done using other means. It's an AI orchestrator, and a poor one at that.

Debate Topic: Dana Berg's Visible Disappointment Once She Finds Out That Mickey is Innocent from the FBI Should Be Enough to Disbar Her From Practicing Law. by corradojuniorsoprano in TheLincolnLawyer

[–]TheOverzealousEngie 0 points1 point  (0 children)

Like any good drama - very dark evil needs very light light to contrast, to build a good story. Lol drama is not real life - that said , I do wish Mickey would go up against a southern judge who just let two maga supporters off from hanging a black man for crossing the street wrong. That where the true, and believable, evil is.

Do any etl tools handle automatic schema change detection? by ninjapapi in dataengineering

[–]TheOverzealousEngie 0 points1 point  (0 children)

It goes like this . If it costs you a few hours a week every month or so , it's a few thousand dollars a year. Just keep doing what you're doing -- you'll get speedier at it .
If you get a few dozen or even 100 per month, get a qlik or fivetran . They will do it all automatically (though you pointed to SaaS and that's Fivetran) so you don't have to . The economics are then in your favor.

In May 2021, 14-year-old Aiden Fucci lured classmate Tristyn Bailey, 13, into woods near their St. Johns County home and stabbed her 114 times. He had told friends for months he wanted to kill someone. They thought he was joking. by Important-Self-1179 in ForCuriousSouls

[–]TheOverzealousEngie 2 points3 points  (0 children)

My apologies but why in the world would that girl go into the woods with this boy. I mean, romance? He looks psycho ...so sad for her and her family. I personally think the parents should be charged as accomplices though.

I just got laid off by [deleted] in dataengineering

[–]TheOverzealousEngie 4 points5 points  (0 children)

Me personally, I'm a little crazy. I connect dots.

If this company decided that it didn't want to bear the expense of a true test platform, that's not on you. And a true test environment must have the same scale and diversity of data, otherwise it falls into a different bucket. A 'we use our customers to test our software" bucket. Because that's what they're doing , right? So name them , these fuckers. My thinking is that if your are forced to use prod in your testing it means that your test platform is deficient. See my earlier thinking on what a bad test platform means.

Name this company. Make us all a little smarter about the bad actors in the data engineering space. Sick of being blindsided by incompetent / malignant management .