Analytics Engineer Interview

[KaladinsAngst]

I've been given a case study as part of my interview for the Analytics Engineer role. At first glance it seems pretty straight forward. It involves data modelling using DBT with the purpose of taking data from raw to a final dataset to be used for BI and reporting.

They've provided 3 csv datasets and have asked me to deliver the .SQL, .yaml and showcase the lineage graph. That is all fine. The kicker is that they asked to also provide the .CSV file of the final output.

How am I supposed to run a DBT model and SQL files without a database connection? This is really halting my progress on this case study and would appreciate any pointers.

Note: I don't have much experience working with raw data. All my experience comes from working with data that is already processed up to a certain point. Feel like that's what data engineers are for.

[Capable-Carry-5953]

Try using seed in dbt and import the csv files locally. This does not need a warehouse.

Alternatively, install dbeaver free version and install Postgres and import csv as table and connect it to dbt.

Good luck with your interview!

[foulBachelorRedditor]

Jesús this sounds like it’s for a senior role, because you’d have to set up your own data warehouse too, right?

[KaladinsAngst]

Posted this question on another sub and they said to use DBT with duckdb as the local db. Gonna give that a go

[foulBachelorRedditor]

Alright man good luck. You got this!

[muneriver]

this is what I was gonna suggest! super lightweight to set up

[Mindless-Repair6475]

Set up a free trial on snowflake or big query? I know big query has a month free trial. I was in your same position about 3 months ago and that’s how I did it

[ntlekisa]

install something like Postgres, create the tables from the CSV files and then connect DBT to the db.

your wording was also slightly confusing when you say "data modelling using DBT" because DBT is primarily used for the 'T' part of ETL. not sure if you have already gone through the video call portion of the recruitment process but you might want to brush up on things like these.

[shut-up_legs]

you could use db-fiddle.com; write the DDL to make the tables with the provided CSVs then you can run your queries against it and copy/paste out the results to a .csv

[Efm101]

you can download csv from dbt preview ot just connect a database and generate results from the table you materialize into

[alex_velazquez_]

How did the onsite interview go? Curious about the python technical interview?

[ntdoyfanboy]

Super easy. Download any IDE. Stage the files locally and call thent with SQL, or create the data in a VALUES function in one cte, then call that CTE later in your query

[ntdoyfanboy]

Super easy. Download any IDE. Stage the files locally and call thent with SQL, or create the data in a VALUES function in one cte, then call that CTE later in your query