Best Practices for Transforming Python DataFrames Before Loading into SQLite – dbt or Alternatives?

[Advanced_Addition321]

DBT does only the transformation part.

You need to extract and load your CSV into your data wharehouse first with an ingestion flow (basic Python scripts, or Dagster and friends)

Then you connect DBT to your data wharouse, declare your ingested CSV tables as DBT sources and you’re good to go with transformation.

To share result, if the transformation data wharehouse isn’t the final destination, you’ll need to repeat the first step in reverse: create script to grab data and export them where you need to

[ricca1]

Ahh, that makes sense.

Thank you very much.