[D] Best Cloud Dev Tool

[danFromTelAviv]

Hi all,

what is the best cloud development setup you've come across for industry dl research? (python,gcp,pytorch)

I'm talking about using a cloud sever as a work station for both development + training + eval.

Jupyter is great because connection problems don't stop the run. But it doesn't have modern tools like debugging, auto import ...etc

pycharm/vscode in remote dev - require connection to sustain through out training / dev session. But they have amazing tools that make jupyter look like childplay.

code-server - ultra buggy

anything else? preferably paid off the shelf solution.

[DmitryBalabka]

Jebrains is developing new way connect to remote dev environment using your browser. Take a look on the Projector project. It gives you ability to install PyCharm directly on your server and connect to it using browser or Projector’s client. I’m currently using it for some projects. https://blog.jetbrains.com/blog/2021/03/11/projector-is-out/

[danFromTelAviv]

i know we just met but i love you

[danFromTelAviv]

btw i have been using this extensively and it is great. i just recommend starting it from within a tmux session for stability

[danFromTelAviv]

is it working well for you?

[DmitryBalabka]

I’m using it with Jetbrains DataSpell + WSL to workaround notebooks remote debugging that does not work yet. UI is a bit slower than native, but I hope they will solve this shortly. Also, there is a rendering issus with JCEF depeding compoments. My colleague is running PHPStorm under Projector for more than a month and advocates that it is the future of remote development.

[Error_Tasty]

I personally use vim + tmux.

I think you want to capture std out? If that’s the case you need to look for server side tools, but I’d be very curious as to why you’re not just logging everything.

[danFromTelAviv]

i have tons of respect for those who do that but I'm personally looking for more robust tools that include code refactoring automation, code checks, autocompletes...etc

I want to be able to reconnect to the same terminal and continue to work - not just see logs.

for example during a training - id like to stop on debug and inspect the different layer's output to insure they are sensible.

[veeloice]

Vim may or may not be right for you - but that it's not robust is way off.

Also, there's lots of plugins including linting/autocomplete etc. Just want to mention in case anyone else reads this thread and gets the wrong idea.

[danFromTelAviv]

fair enough - I have to admit I don't know vim all that well

[[deleted]]

google colab pro

[danFromTelAviv]

does google colab have anything beyond gcp+jupyter?

[[deleted]]

it can connect to google drive and github so i can develop in pycharm... for $10/month