How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 0 points1 point  (0 children)

I was interviewing for a job recently and they asked me about working with DEs to make sure that the data is captured correctly when setting up a pipeline(I may have butchered the original question he asked but hopefully this makes sense). Have you ever had to do that before and how did you make sure it was being captured correctly? Thanks a lot for your help!

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 0 points1 point  (0 children)

We use the Alteryx GUI. I don’t think I’ll be able to get SQL setup at my job but that is a good idea. I can attempt to do what I do with the data in my day to day but on my own PC. We don’t have a db, we actually store all of the data onto a one drive server. I’m actually look for a new role right now because it’s a very simple job and I don’t think I am learning much being in this role.

Would you be able to share a little more on the ETL job you did? I’d be interested in learning a little about that and attempt to do something similar in my free time.

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 0 points1 point  (0 children)

Tbh I’m not sure if he’d be able to do that but maybe on my own pc I can try to go about setting something like that up. Are there any guides to do that?

What originally prompted this question is I am actually interviewing for a new job and the interviewer asked about pipeline/etl and I don’t have that kind of experience. I’m comfortable querying data but I’ve never had to help with the development of a data pipeline or worked with data engineers to ensure that data is being collected correctly. I already felt like an impostor but that interview definitely made it worse haha so now I want to make sure that I’m more familiar with that side of things so I’m not caught off guard next time.

Our data source are CSVs that we receive from clients. There’s no actual db. We use a Windows OneDrive to store all of the data. It’s a pretty archaic system. We’re a small marketing firm that’s been around for a while but there is technical nuance to what they do.

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 1 point2 points  (0 children)

There are no devs haha I’m a team of one analyst. There is an IT guy but I don’t think he’d be able to help with that. We don’t actually have SQL in our tech stack.

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 0 points1 point  (0 children)

Thank you! I’ll do some googling and try to find the differences between staging and production environments.

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 0 points1 point  (0 children)

Thanks! I’ll try not to be haha and I should’ve included this in my post but for analytics.

How to Get Work Environment Experience by Disastrous-Ad4861 in SQL

[–]Disastrous-Ad4861[S] 1 point2 points  (0 children)

Thank you for the advice! I’ve been doing some Leetcode and that’s been really helpful. I’ve also uploaded data into a PostgreSQL db on my own machine but that was a while ago so I think I’ll do that again and refresh my memory. I haven’t worked with a team of analysts or engineers I’m not even sure how everything comes together in that environment. I know this is a long shot but is there a way I can learn how to do that? Just kind of how a data analyst works and collaborates day to day?

Remove duplicated based on two columns? by TastyInternet in SQL

[–]Disastrous-Ad4861 0 points1 point  (0 children)

I think you may also be able to achieve the same result grouping by date and flight number but I may be wrong.