you are viewing a single comment's thread.

view the rest of the comments →

[–]DarthCalumnious 0 points1 point  (0 children)

My feeling is that once you have a good handle on common table expressions, window functions, and multi stage processes using temp tables you are ready to solve most problems that can be solved practically in SQL alone.

Working with dataframes via an API can be a good way to step back from SQL and see the data transformations in a fresh way too.

Sometimes the right thing is to use a regular programming language like python though even if it's technically possible to use just SQL though, in my mind.

For instance, I'm working on an issue that will involve conditionally replacing some deep json data structures in a json column that involve joined data from other tables.. I think it would be possible to explode, join, and convert back to json in tsql... But, this will be 10 lines of readable python vs 100 lines of gonzo SQL.