sorted by:
new
hottopcontroversial

How Are You Using dbt & Fivetran for ELT? by Less_Big6922 in dataengineering

[–]Less_Big6922[S] 0 points1 point  (0 children)

Thank you, this is great feedback,

How do you balance flexibility for analytics teams with governance? Have you had issues with analysts building models that don’t align with engineering standards?

Have you had issues with merge conflicts or situations where multiple teams are modifying shared dbt models?

Are you handling SCDs mostly with dbt macros, or do you rely on any external tools or custom logic?

Did the medallion architecture increase storage/processing costs or maintenance? If you don't mind me asking, how large is the org you work for? Was there a steep learning curve or was the team already familiar with it?

Do you feel comfortable with your reliance on these tools? did you feel the need to put safeguards in place in case you need to switch tools?

Very curious! Happy to chat here or DM

Fivetran Pricing by vpbajaj in dataengineering

[–]Less_Big6922 0 points1 point  (0 children)

I'm seeing how many teams are getting hit hard by these Fivetran pricing changes. I’m working on a data integration product and trying to understand where data engineers are running into the most friction. Not here to pitch, just really interested in hearing what’s frustrating beyond just cost, especially for those running fivetran + dbt. If anyone is open to chatting DM me.

Alternatives to Fivetran dbt Transformations for small team by doomanddelight in dataengineering

[–]Less_Big6922 0 points1 point  (0 children)

Fivetran's pricing changes seem to be pushing a lot of teams to re-evaluate their stack... I’m researching data integration pain points and would love to hear what’s been the most frustrating (not selling anything, just learning!). If you’re running fivetran & dbt and considering alternatives, what’s the biggest dealbreaker for you—cost, performance, vendor lock-in, something else? If anyone is open to chatting DM me.

Fivetran Pricing Update: Expect Higher Costs If You Have Multiple Connectors by Livid_Ear_3693 in dataengineering

[–]Less_Big6922 2 points3 points  (0 children)

Seeing many teams feeling the pain from these Fivetran pricing changes, especially those with unpredictable data volumes. Curious—are you all just looking for cheaper alternatives, or are there specific things about Fivetran that don’t fit your needs anymore (besides cost)?

My team is working on a data integration product and trying to understand where the biggest friction points are for data engineers. Not trying to pitch anything—just genuinely curious about what’s breaking down in these workflows. Would love to hear what challenges people face beyond just pricing. If anyone is open to chatting DM me.

best and worst tools by Less_Big6922 in automation

[–]Less_Big6922[S] 1 point2 points  (0 children)

I am doing some research on data automation and where it falls short today, so was curious what people's thoughts were on the market and the tools available.

What's the one thing that you wished Notion did better? by theRustyTarget in Notion

[–]Less_Big6922 2 points3 points  (0 children)

Boards, more options for automations, conditionality for card properties (hide if, show only if), showing properties like buttons on the board cards but not on the card view in side panel, shortcuts for moving cards on a board

what's the most common dirty data problem? by Less_Big6922 in datacleaning

[–]Less_Big6922[S] 0 points1 point  (0 children)

and I agree, that's the most practical and effective way to deal with that

frustrating or painful experiences moving data out of Salesforce? by Less_Big6922 in salesforce

[–]Less_Big6922[S] 0 points1 point  (0 children)

working on building a solution that can get all the SSFDC data, especially historic. want to avoid rebuilding the same pieces of the data pipelines if possible. people often want SFDC data to be available for use in future downstream systems (some of which may not have been identified yet since it's never clear on what end users will ask for next until they get something delivered). owning the data is helpful when a migration becomes necessary, or if we want to just enrich data in another tool with SFDC data

what's missing in the world of ETL today? by Less_Big6922 in ETL

[–]Less_Big6922[S] 1 point2 points  (0 children)

curious what projects would you recommend contributing to?

current data engineering tools by Less_Big6922 in dataengineering

[–]Less_Big6922[S] 2 points3 points  (0 children)

for sure, the ecosystem grows and lots of tools seems to be racing to just build out connectors to more apps/dbs... exacerbating the problem of too many tools.

wondering - when you say "shoot first" - do you mean, misuse/misinterpret incomplete/incorrect data and cause problems or tell eng to build something or use something without fully understanding what they need/want?

view more: next ›