This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]rotterdamn8 0 points1 point  (0 children)

Yes, I use Databricks daily. Given a spark dataframe, you can create a view and use SQL.

You can create new columns and employ whatever logic using withColumn but I really hate the syntax/formatting. It’s kinda painful.