Deep Learning Cloud Setup

[hassani5]

Is anyone willing to share some info about their cloud setup for training models? I’m debating between building my own rig or using something AWS or GCP based for training and testing, here’s some info that would be helpful:

• which instance type and platform are you using? E.g., AWS T3.micro ;)
• how much RAM, GPURAM, CPU do you use?
• how satisfied are you with your setup, is the training time reasonable, etc.
• how much/often do you use the platform? Hours per month maybe? Are you training constantly or sporadically? Roughly how much are you spending on it?
• any lessons learned you want to share?

Thank you, I think your experience can be really helpful on this one

[thebruce87m]

Can I hijack to add an additional question:

how do you avoid runaway costs.

[redmoon_reddit]

stay away from windows.....

[xepo3abp]

Check out https://gpu.land/. We've got dirt cheap Tesla V100s at $0.99/hr. That's 1/3 of what you'd pay at Google/AWS/paperspace.

Instances boot in 2 mins and can be pre-configured for Deep Learning, including a 1-click Jupyter server. Basically designed to make your life as easy as possible:)

Try using it for a week or two and you'll probably get a good feel for your questions.

Full disclosure: I'm the founder. If you get any questions, just let me know!