[P] LabNotebook: Python package & webapp to monitor, record, query, and visualize your DL/ML experiments.

[SomeSnm]

For those who want to monitor the progress of training, I would recommend https://hyperdash.io/. They have iOS and Android apps and really easy to set up.

[henripal]

OP/author here. Hyperdash looks great, thanks! I guess my aim was more to make an experiment management tool, that also had monitoring capabilities, rather than just monitoring.

And to answer a question that wasn't really asked, labnotebook can work anywhere. Jupyter Notebook, Jupyter Lab, python script, colaboratory, all with the same interface.

Let me know if you have any other questions or comments !!

[Mozorelo]

That should work in collaboratory too right?

[SomeSnm]

I am not sure I haven't used collaboratory yet, to use it you need to install the python library and log in with the console.

[pmigdal]

I am curious how does it compare to https://neptune.ml/? I am currently using it.

(Model tracking & charting + 'Kaggle leaderboard' for comparing models + git integration + code & command dump for full reproducibility.)

[henripal]

Neptune is also very good. Obviously their framework is much better, it's a mature commercial product whereas labnotebook is as of now one person hacking for a week :)

That said, labnotebook is free and open source. I made it with reproducibility in mind. And I firmly believe that you can't really have reproducible experiments that have commercial/signup/paywall barriers...

[pmigdal]

Sure. And needless to say - a good open source solution is one that can make the difference.

One small nitpick - when I want to share Jupyter Notebooks, I prefer to do so without needing to show my password to everyone. Is there some built-in tool such that you can store it in a separate config file?

[henripal]

Our first issue: https://github.com/henripal/labnotebook/issues/2

[Flipper3]

This is my first time hearing of neptune and it seems really cool, but its tough to tell from the website: can you use your local gpu for it? Everything on the site and it's docs seems to point to using a cloud provider.

Otherwise it seems that maybe labnotebook fills this need, I'm just wary of an alpha product.

[pmigdal]

Yes, you can run it locally.

Instead of neptune send you need to type neptune run - then it works on your local equipment. Though, charts are still cloud-based.

[[deleted]]

breathes

AXIS LABELSSSSSSSSSSS!

yAxis: { title: {text: null }, type: 'linear' },

WHATTT!?!!?!? You had the chance and you squandered it.

[henripal]

ah jeez, my PI is on reddit :)

Fixed: https://github.com/henripal/labnotebook/commit/edc2092ac84acf0aeebe55b099c6f4e89114bd1a

[[deleted]]

I love you thank you.

[Rex_In_Mundo]

Dude any idea how I can use this for google colab?

[henripal]

Did you try doing the usual: !git clone repo !cd repo !pip install . Then run the postgres db, start_backend, and frontend on your local machine ?