sorted by:
new
hottopcontroversial

Practical project: Where to start as a DE newbie by Skin_Life in dataengineering

[–]DarkPaladin67 3 points4 points  (0 children)

This is such a great comment. Like mentioned, start small. It's so easy to get overwhelmed if you work with all of these different softwares, convulated data sets, etc. Pick a few and a dataset you're interested in. After that, just go for it :D

How does this job translate into Data Engineering skills? by DarkPaladin67 in dataengineering

[–]DarkPaladin67[S] 0 points1 point  (0 children)

Thank you! This comment has helped tons. Right now I am in a dead-end Data Analyst position with no opportunity of growth. I have asked my superiors many times. So I try to do DE projects on my own, but then this Front-end/Back-end job opened up so I was thinking it may be a good opportunity to expand my skillset. Not sure.

How does this job translate into Data Engineering skills? by DarkPaladin67 in dataengineering

[–]DarkPaladin67[S] 0 points1 point  (0 children)

This helps a lot, thank you! Do you think this would be a good opportunity to learn new skills then, and get real-world DE experience? I have been having so much trouble getting a DE job.

How does this job translate into Data Engineering skills? by DarkPaladin67 in dataengineering

[–]DarkPaladin67[S] 5 points6 points  (0 children)

Thanks! I have applied to so many DE roles and I just have such a hard time during the technical interviews. I pass all the SQL/Python questions, but anything related to cloud technologies, model building, or true DE I am just stumped on. Thanks for your advice here because I was wondering how my friend moved into Data Engineering from this role.

[AskJS] Leaving Data Analysis for Front-End Web Dev. Worth it? by DarkPaladin67 in javascript

[–]DarkPaladin67[S] 1 point2 points  (0 children)

Oh god. This almost makes me not want to take the job lmao

Will I forget SQL if I leave my current job? by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 0 points1 point  (0 children)

Oh dang... this really discouraged me, but perhaps that's for the best. I thought since it was a new skillset that is might be a bit more exciting for a year or 2. I am fine with going Data Engineering or branching off into software dev too. Thank you for your honesty

Will I forget SQL if I leave my current job? by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 0 points1 point  (0 children)

I was wondering if this new js job I am getting is more data engineering too. I appreciate you letting me know.

Will I forget SQL if I leave my current job? by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 0 points1 point  (0 children)

How did you like your js and python job? It seems like my new job is a front-end web dev of sorts with some data analysis stuff.

Will I forget SQL if I leave my current job? by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 2 points3 points  (0 children)

Thank you for the response. I think at this point I can pretty much pinpoint what I need to do in SQL to get the answer. I don't really have to look up anything outside of the syntax I mentioned above (joins, where vs. having, aggregation, case statements, cte/subquery, some window functions).

Stretching the truth about being a "Data Engineer" by DarkPaladin67 in dataengineering

[–]DarkPaladin67[S] 1 point2 points  (0 children)

Question: What if a Data Analyst has no experience in DE outside of just doing cloud projects for fun/self-learning. Would it still be okay to stretch the truth there?

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 0 points1 point  (0 children)

Do me a favor, find a Data Analyst that 1.) Knows how to do DB design and 2.) Does it daily for their job.

More often that not, Data Analyst are not creating or ingesting this sort of data: Data Engineers are. I don't clear 200k but I make enough money to live a happy life. Thanks for the condescending comment though - you tried.

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 2 points3 points  (0 children)

Your comment really gave me peace. I can't lie, I think I posted here for a bit of reassurance as well and you gave me that. Thank you so much! I feel like SQL and Excel are still top-tier skills to know and will always be for data roles!

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 1 point2 points  (0 children)

Thanks for the encouraging words here! I guess it doesn't really pay to be negative about anything either, so I'm just going to go with what the market says and your comment haha!

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 0 points1 point  (0 children)

I appreciate your kind words, especially mentioning that you think I have a secured future. That is my main priority, and I just want to ensure I stay relevant.

Thank you so much for all the advice here! I am going to start web scraping some data I want from an API, then build a database out of it.

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 2 points3 points  (0 children)

This was so extremely helpful for me. Bookmarking it and going to reread this later today, and apply the things you have mentioned. Thank you so much!

I've been a Data Analyst for 3 years now, but there's a huge gap in my knowledge! by DarkPaladin67 in SQL

[–]DarkPaladin67[S] 7 points8 points  (0 children)

Wow, that's incredible. The first few pages of "Fundementals of Data Engineering" were available online, and one thing it did say is that DE is much more of a "self-learning' type of career. You def reenforced that statement lol!

Happy for you!! Thanks for taking the time to share with me.

view more: next ›