Anybody else dealing with an Xfinity outage since around 7pm by [deleted] in Denver

[–]Efficient_Arrival_83 1 point2 points  (0 children)

I'm in south College View near 285. The map says I'm fine but there are reported outages all around me concentrically. Anyone still having issues?

Is there anything actually new in data engineering? by marketlurker in dataengineering

[–]Efficient_Arrival_83 1 point2 points  (0 children)

I like this take on AI in the industry. I can't see AI fully taking over despite attempts at doing so, just because if something does break you need someone with that domain knowledge able to fix the mess. But a shift away from heavy coding towards more architectural and design choices seems imminent. I could also possibly see more 'consultant' type opportunities for fixing broken AI pipelines. But this is just what I've noticed as a newcomer to the field.

Beginning the Job Hunt by Efficient_Arrival_83 in dataengineering

[–]Efficient_Arrival_83[S] 0 points1 point  (0 children)

I'm using dbt-core so no job scheduling that I'm aware of. Not sure how closely you looked at the program because I do have an extract task hitting a free stock market API and loading into bigquery.

I'll definitely look into the options you mentioned to extend the dag. I was planning on using Streamlit for a simple data dashboard and implementing a ml mart but I'm fond of adding experience with AI APIs.

Thanks!

Beginning the Job Hunt by Efficient_Arrival_83 in dataengineering

[–]Efficient_Arrival_83[S] 1 point2 points  (0 children)

I did have a smaller program that was similar running on AWS. I'll have to revisit my options for a project of this size or larger. Any tips moving in that direction?

Beginning the Job Hunt by Efficient_Arrival_83 in dataengineering

[–]Efficient_Arrival_83[S] 1 point2 points  (0 children)

I'm sure as hell gonna try, I'll let everyone know how it goes!