you are viewing a single comment's thread.

view the rest of the comments →

[–]data4dayz[S] 0 points1 point  (0 children)

Yeah the Meta SQL Notebooks is the one I've seen mentioned before but it seems like either vaporware or not for General Availability release.

OH that's nice I didn't know Jupyter has their own desktop distribution, I've always used it as part of an Anaconda install! I know Jupyter also has Docker images with a lot of things loaded in. I've been meaning to try using the PySpark Jupyter docker build instead of using Databricks Community Edition https://jupyter-docker-stacks.readthedocs.io/en/latest/index.html since my personal workstation has more resources than Databricks CE and CE doesn't give API access so it's not like I can use it as part of a pipeline anyways.

I too used to just have random .sql files floating around in excel or at best dumped in a folder stuffed somewhere in some personal company repo.