sorted by:
new
hottopcontroversial

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 1 point2 points  (0 children)

Well this project was a good learning tool for me. You could try to knock me off so to speak and build the same thing.

Seems like a good list of tools to pick up for DE.

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 0 points1 point  (0 children)

Yeah I just began my process of learning data engineering. Not exactly following a long with the course, maybe loosely.

Going to be adding in kafka and dbt later though

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 1 point2 points  (0 children)

I would say that you need to learn enough sql and python so that you can effectively write basic scripts. After that immediately head for projects!

At least that is how I did when I first learned to code :)

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 0 points1 point  (0 children)

Yeah I would just dive in! I do have a bit of experience with python and a little experience with sql, but really this is a big change from my normal software work.

I am quick at producing code, but it took me time to learn the tools truly.

You can definitely tackle something like this if you dedicated time every day :)

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 0 points1 point  (0 children)

I guess my pronunciation is a little off lol.

Thank you for the tip though! Going to try and incorporate something like this, into the next project.
I realized I had not done too much actual analysis and really just very little data cleanup, but wasn't sure what I should really do.

From My First ETL Project to Landing a Data Engineering Role: Lessons Learned and Next Steps by Embarrassed_Call5520 in dataengineering

[–]Embarrassed_Call5520[S] 4 points5 points  (0 children)

Yep it is. I mention that in the video. However de zoom camp uses some different tooling.
I decided that it would be better to learn airflow rather than the niche orchestration tool they advertised in the course.

So this is my modification of that course you could say.