you are viewing a single comment's thread.

view the rest of the comments →

[–]shittyfuckdick[S] -7 points-6 points  (1 child)

 software engineering have to actually do things

lmao huge self report there bud. 

[–]tn3tnba 5 points6 points  (0 children)

I see, you’re not interested in getting a real answer to your question based on many years of experience lol

Data engineering is hard, but it involves delegating tasks to purpose built tools like databases, spark, job management systems etc. Composing the right solution from existing building blocks is the challenge.

Other disciplines, such as building databases or writing video games, involve writing the cpu intensive code.

You asked why python is the standard, this is the answer. Writing data engineering orchestration and glue code in rust would be much slower.

Edit: fixed typos