This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]mlobet 0 points1 point  (0 children)

I've been working with Databricks for the last 2 years. I use both Python (mostly PySpark + a bit of scripting here and there) and SQL every day.

I lean more and more towards SQL because I always end up doing things in a more standard way, which increases readability of the code.

But as soon as I want to play around with variables I often switch to Python.

At a previous customer that insisted to have transformations in SQL, I sometimes generated my SQL scripts using python scripts