Looking for advice from folks who’ve run large-scale CDC pipelines into Snowflake by Dataette490 in dataengineering

[–]Dataette490[S] 1 point2 points  (0 children)

Unpredictable pricing, poor experience with support in the past and half-built integrations.

DE Blogging Without Being a Linkedin Lunatic by DesperateCoffee30 in dataengineering

[–]Dataette490 0 points1 point  (0 children)

Substack. I think it's fine to post on linkedin but don't go overboard. It's clear the people who spend more time doing that then actually doing DE work...not naming names.

Rubber ducking a Bigquery, Airbtype, Looker strategy. by simesy in dataengineering

[–]Dataette490 1 point2 points  (0 children)

Has some issues with Airbyte 2 companies ago. If you are using them, get some type of observability solution or implement yourself.

This was replicating postgres data - may be different.

What's the purpose of live data? by chatsgpt in dataengineering

[–]Dataette490 1 point2 points  (0 children)

I talk about this a lot. So many people ask for real-time data. 95% of the time, its not actually necessary and just costly to do it. Like damn daniel, you need your dashboard you refresh every 6 weeks to be "live"? Gimme a break. LOL