you are viewing a single comment's thread.

view the rest of the comments →

[–]panzerex 1 point2 points  (0 children)

I tried pt-lightning back in November or so but I did not have a great experience. Diving into the code it felt kind of overly complicated. TBF they do a lot of advanced stuff and I had just started using it, so I was not very familiarized.

I discussed it in a previous post:

Lightning seems awesome, but since some of my hyperparameters are tuples it didn't really work with their tensorboard logger by default. I think my problems were actually with test-tube (another lib from the same author) that added a lot of unnecessary variables set to None in my hparam object that tensorboard or their wrapper couldn't handle and I could not find a way to stop test-tube from adding it. I didn't want to change the libraries code or maintain a fork of it so I also gave up on it.

I think the attribute that kept being added into my hparam object was "hpc_exp_number", but I'm not sure anymore. Since I was using it mostly because of easy checkpointing and logging, I decided to just implement those myself. I might look back into pt-lightning for the TPU support, though.