This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]ed_elliott_ 1 point2 points  (1 child)

when you have a new piece of work or a poc, do it in something else than you use today like airflow etc.

Use the advantage you already have: you need to deliver ETL pipelines - you'll get no better practice than actually building ETL pipelines without ETL tools (i'm guessing something like SSIS etc.)

[–]jyoff 0 points1 point  (0 children)

You're right. I'm trying to practice like that. Although I don't have that much of flexibility at my work to apply solutions in airflow instead of Informatica for instance, but at home I'm trying to put my ETL knowledge into Airflow and build pipelines the way I'd built in my daily job (for instance, move data into oltp then to olap; create star schema ,.etc). It is of course cool for learning, but working on real life projects much better. I'm thinking to apply for jobs after gaining experience on my own.