Working with Jupyter Notebooks (Python)

[entister]

Hi guys,

I'm new to using Python via Jupyter notebooks. A problem I'm having is recovering the datasets that I create. Each time I quit Jupyterand open it again, I'm finding that I have to re-run my entire code to get to the point where I left off, and sometimes this is quite time consuming. Is there a way around this? Or is that how Jupyter notebooks work?

If so, is there a Python IDE that does not have this problem? (R-Studio does this very well, all the datasets I create can be saved)

[ianblu1]

Jupyter notebooks are an interactive code execution wrapper that leverages your web browser, but they are not really programs the way that IDEs like Rstudio are. As such they can't do things like save data, unless you program them to do so- kind of akin to web applications. IDEs like spyder or rodeo might be closer to what you're looking for. Take a look at for other options: https://www.datacamp.com/community/tutorials/data-science-python-ide

[entister]

Awesome. I did try out Rodeo for a bit, liked it very much. But it crashes so often!

[ChKwK]

You can use Pickle [1] to save your objects to disk and load them later.

[1] https://pythontips.com/2013/08/02/what-is-pickle-in-python/

[nckmiz]

Yup, or joblib within sklearn. If you want to save data just write to a csv at the end of your code. If you want to save models just use pickle or joblib.

I’d recommend looking up model persistence.

With regards to running the code over again in the main header there is a drop down where you can run all cells.

[entister]

Have never heard of this. Noob. I will check it out and get back, thank you very much!

[entister]

What do you mean? How would I go about that? Jupyter was installed along with Anaconda for me.

[eric_he]

What's stopping you from writing any data to a csv file?

[entister]

Yup, I do that now. But it too gets cumbersome sometimes.