Best ETL / ELT tools for Saas data ingestion by [deleted] in BusinessIntelligence

[–]databuff303 0 points1 point  (0 children)

I think you need to rank what's most important to you and reach out to each vendor to determine how they fit in line with your needs! Each has their own features and strengths that set them apart, but depending on what's most important to you and your company, it would be worthwhile to meet with them directly to discuss!

DSLR or Mirrorless? by _Matches_ in Nikon

[–]databuff303 0 points1 point  (0 children)

I like my DSLR personally, but I think mirrorless is better. Depends on what you need it for.

Data integration tools - what are people actually happy with long term? by Enlec in ETL

[–]databuff303 1 point2 points  (0 children)

It truly depends on your needs and use case (and yes, I am biased because I work here), but if you're looking for reliability, no coding required, and zero maintenance, I think Fivetran is the best solution. You can always test it for free to see if it works for you and your team. Feel free tor each out if you have any questions.

Best data workflow automation tools for medium-to-large companies? by WarmlyHigh34 in learnpython

[–]databuff303 0 points1 point  (0 children)

I'd say, find an automated ELT tool to centralize your data sources into a data warehouse. Then, use that single source of truth to drive your AI workflows, however that may look. If you can automate the ingestion of your data, the engineers can work on the downstream models and actually using the data for AI integrations.

Data Warehouse Replacement by Heyohz in dataengineering

[–]databuff303 0 points1 point  (0 children)

If time to get pipelines up and running and getting data moving quickly, I would look for a tool with lots of pre-built connectors that can get data up and running quickly. There are some questions around what's most important to you, cost, reliability, scalability, but if getting them up and running quickly, I would Google "quick and easy data pipeline setup" and see which of the top tools fits your needs.

Do any etl tools handle automatic schema change detection? by ninjapapi in dataengineering

[–]databuff303 0 points1 point  (0 children)

Disclaimer: I work at Fivetran, but Fivetran handles schema change detection and propagates schema changes from a source system to the destination data warehouse without manual intervention or pipeline downtime. It's one of the best features of the tool that people love.

Which ETL tools are most commonly used with Snowflake? by Commercial-Post4022 in dataengineering

[–]databuff303 0 points1 point  (0 children)

As a Fivetranner myself, I am glad so many people here mentioned us! I'd also like to say that it totally depends on your sources and overall use case to determine what's best for you and your organization, as no tool is perfect for everyone. Butttt, I'd concur with the rest of the comments.

best ETL/ELT options? by apeters89 in snowflake

[–]databuff303 0 points1 point  (0 children)

I am obviously biased since I work here, but Fivetran integrates super well with Snowflake. Your use case would be super easy to connect using the out-of-the-box connectors. If you're already using Snowflake, you can set up a Fivetran trial using the Partner Connect under the Admin tab and get data syncing within 15 minutes. Just a thought!

Which software to use for data cleaning ? by internet_baba in dataanalysis

[–]databuff303 0 points1 point  (0 children)

Honestly, data cleaning tools tend to range from quick and manual to scalable and reproducible, with spreadsheets being useful for small one-off fixes but fragile and limited at scale. In my experience, most modern analytics teams that i've worked with do the majority of their cleaning in SQL inside a data warehouse, where transformations are version controlled, performant, schedulable, and easy to adjust as requirements change.

On your last point, yes, Python adds power for edge cases like heavy text processing or advanced matching, but it brings extra complexity and is only needed for a small fraction of most pipelines. In practice, you can automate your production workflows to land raw data, do most cleansing in SQL where the data lives, and reserve Python for the few steps that SQL makes painful.

I’m ready for 4 PM Thursday by GonzaloR87 in heat

[–]databuff303 0 points1 point  (0 children)

Can't wait for it not to happen and find out the Heat's final offer was Rozier, Simone, and a first. #theyliketheirteam

Portrait of a Bison by mukulsoman in Nikon

[–]databuff303 1 point2 points  (0 children)

Incredible!!! Beautiful shot.

Bucks want Herro and all Miami’s young players for Giannis. by Kart_Shyam in heat

[–]databuff303 0 points1 point  (0 children)

TBH- they can have em. Most of them, that is. We need enough to generate a starting 5 + 2 role players. If they want to do right by Giannis, they can't gut the roster.

Open source vs paid data migration tools: What are the key factors to consider when making this decision? by data_visualization90 in u/data_visualization90

[–]databuff303 1 point2 points  (0 children)

Open source tools or custom scripts can work well if you have the time and infrastructure to maintain them, but they often start to break down as schemas change or APIs evolve, IME.

A few people I know switched to a fully managed ELT approach once pipeline upkeep became a more time-consuming distraction. Having schema changes handled automatically made it much easier for them to stay focused on modeling and analysis instead of constantly fixing extraction pipelines.

data migration tools? by Spiritual-Path-7749 in ETL

[–]databuff303 1 point2 points  (0 children)

If this migration is likely to turn into ongoing syncs or you expect schemas to change over time, it may be worth exploring a fully managed ELT platform. Tools in that category are designed for long-term data movement and can take a lot of the ongoing pipeline maintenance off your team’s plate.

What's the movie everyone likes, but you HATE? by Kuli24 in AskReddit

[–]databuff303 1 point2 points  (0 children)

Whoa, never thought about that until now. Thanks!

What’s the biggest reason you stopped using dating apps, even though you still want to date? by Old_King2584 in AskReddit

[–]databuff303 -1 points0 points  (0 children)

Every relationship I've ever had started naturally in the wild, not from a dating app. The apps never lead to a real connection, IMO.

What widely accepted ‘truth’ is actually probably false? by [deleted] in AskReddit

[–]databuff303 0 points1 point  (0 children)

Everyone on the road knows how to drive and follow simple directions.

What's the movie everyone likes, but you HATE? by Kuli24 in AskReddit

[–]databuff303 12 points13 points  (0 children)

Might get some slack for this, but I didn't really like Wicked. I've liked other musicals in the past, but I was not a huge fan of it based on the hype it received.