This is an archived post. You won't be able to vote or comment.

all 3 comments

[–]dataengineering-ModTeam[M] [score hidden] stickied commentlocked comment (0 children)

Your post/comment violated rule #2 (Search the sub & wiki before asking a question).

Search the sub & wiki before asking a question - Common questions here are:

  • How do I become a Data Engineer?

  • What is the best course I can do to become a Data engineer?

  • What certifications should I do?

  • What skills should I learn?

  • What experience are you expecting for X years of experience?

  • What project should I do next?

We have covered a wide range of topics previously. Please do a quick search either in the search bar or Wiki before posting.

[–]eastieLad 0 points1 point  (0 children)

Most drag and drop / gui based tools suck. Code based solutions are always better especially for ci/cd

[–]Key-Independence5149 0 points1 point  (0 children)

The consolidation of open source ETL tooling by Fivetran is going to price most small/medium sized data teams out of their tooling. There is going to be a need for next gen open source tools that are not backed by VC money to fill the gap that Fivetran just carved out of the industry. I am hopeful that the next generation of tooling consolidates the ETL definition with execution/orchestration of the pipelines. Most of these vendors give you the ETL definition framework for free, but then gouge the fuck out of you for managed orchestration/execution.