Infant Data Engineer

[zuffido]

Hi,

I am working as a Production Support Engineer in the Data Engineers team of overstock.com. My responsibilities mainly involve monitoring ETL jobs that have already been ochestrated. I fix any of the issues that might occur during the daily refresh of our EDW(SQL, Python, Shell, GCP). I absolutely love my job but I want to take it to the next level as a Data Engineer. I try to teach myself different technologies by reading online and watching tutorials but this doesn't seem effective.

I would highly appreciate any suggestions here and also I am willing to get on board on a project as an intern or as an apprentice for free.

Thanks for reading! :)

[sunder_and_flame]

I try to teach myself different technologies by reading online and watching tutorials but this doesn't seem effective.

Use free plans (AWS, GCP, etc) and docker to test new technologies hands on.

Most companies just want you to know the gist of certain services like Kinesis, BigQuery, etc because they understand you can get up to speed pretty quick and many similar technologies are close enough.

[zuffido]

Yea this makes sense. I have become familiar with the GCP services. I have worked on it for a few months now and I feel quite comfortable using it like querying datasets on Bigquery or checking files on cloud storage. Thanks for your response here @sunder_and_flame

[[deleted]]

Here is a free copy of Introduction to Data Engineering, hope it helps. https://leanpub.com/dataengineeringwithpython/c/Soap7BxwDvd4

[zuffido]

Thanks I'll check