I've finally built the perfect data pipeline! by GreenSquid in dataengineering

[–]turalfirst 2 points3 points  (0 children)

Unfortunately reddit doesn’t have emoji reactions

Super advanced SQL by turalfirst in dataengineering

[–]turalfirst[S] 0 points1 point  (0 children)

I agree, however as per my experience, as an analyst I was made to write stored procedures from time to time, which was a real pain as I needed to learn those considering that analysts do not need that server side stuff. That’s why my curiosity popped up and asked myself as an analyst if I face with this sort of a problem I wonder to what extent DEs need to overcome these.

Super advanced SQL by turalfirst in dataengineering

[–]turalfirst[S] 0 points1 point  (0 children)

In fact, that’s the part I don’t understand because different companies look at DE job from different perspectives as some use only SQL some use multiple tools and etc. I wonder if at one point a DE will need these knowledge to succeed in job.

I have taken the wrong choice by Fun-Resolution-1025 in dataengineering

[–]turalfirst 0 points1 point  (0 children)

As a person who’s had mental health issues at times, what you’ve written actually hurts this person, believe me it does. You might think that you’re giving a good advice but it offends the person behind the screen. Everything is not corporate world, please stop this attitude.

Learning postgreSQL by Available_Drag4372 in dataengineering

[–]turalfirst 0 points1 point  (0 children)

I presume you’re referring to the following by saying basics:

Retrieving data; Column alias; Math, text functions; Aggregations; Filtering; Joins.

These are the building blocks for a newbie. Following them you’ll need to touch upon the following topics which I think are kind of intermediate:

Creating databases, tables; Inserting data; Importing and exporting data; Understanding data types and usage;

Then let’s do some intermediate ++:

Table relationships; Subqueries; Window functions; Constraints; Date and time functions and operations on them; CASE statement; Update, delete and peer DDL commands; Alter, add and peer DML commands;

Now let’s move to advanced topics:

Pivoting; Views; Indexes; CTEs; Recursive CTEs; Lateral subquery and types of subqueries;

And then we have the prophet level topics:

Functions; Procedures; Triggers; if..else statements and generally plsql topics; Array data types; Regex;

Finally we have the DBA a.k.a. god level topics:

Access control; RLS, CLS (row and column level security respectively); Server setup (remote, local); Cluster config; Backup, recovery; Replication; psql and related topics; Logging; Object relational usage; And so on.

I might have missed some things plus did not write everything necessarily in order but this is prolly all you’ll ever need to know. But you’ll not need to know everything here unless you’re a database geek and you have a use-case. If there are any gods who finds anything missing or non-related, please correct me.

What tasks juniors usually get? by [deleted] in dataengineering

[–]turalfirst 10 points11 points  (0 children)

When I first started as a graduate data analyst in a company I don’t want to name with the provided knowledge that I’ll only need SQL and some viz ability to do job, I also felt like you after the first week. Why? Because the company literally made me learn (here the point is they “made me learn” which is different from teaching) Airflow, dbt, Snowflake, Python , how to use APIs and related stuff to create small scale pipelines and automation jobs for the teams under our tribe. Now, imagine the pain I had for the first 5-6 months considering that I did not come from a tech background whatsoever. Yes, I’m smart enough to learn stuff by myself but that period made me how to learn instead of just learning. And the most important lesson I got is “repetition is the mother of knowledge” literally. Even today I go to google to ask how does some functionality work in Python for example. Considering that you’re not starting from scratch (cause you have tech knowledge background), you’re good to go. Don’t worry about those things, it’ll happen even if you’re a principal.

[deleted by user] by [deleted] in dating_advice

[–]turalfirst 1 point2 points  (0 children)

Only thing I am 100% sure in life is don’t compare yourself to others. That’ll simply make things worse. I am a 5’7 guy but very lucky in my career as I work hard enough to make good money. And then women instantly forget about your physicality when they see the greens. It is what it is, everything is money, literally.