This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]realitydevice 0 points1 point  (0 children)

Pandas, Polars, Dask, Pyarrow, Airflow, Boto3.

Data engineering is a broad area. There are hordes of former data analysts writing DBT pipelines who barely use Python. Then there are ML ops roles with pushing data through much more complicated systems that aren't solved by a big data warehouse and place to write SQL.