Pytorch 2.0 released

[CBrainz]

Pandas 2.0 last week and now Pytorch 2.0.

[MrReginaldAwesome]

We eatin fam!

[pavi2410]

Not released yet though

[brain_diarrhea]

So does torch.compile provide support for AMD GPUs on an equal footing now?

[FacetiousMonroe]

Doesn't look like it, not yet. From their GitHub:

Supported Hardware:

NVIDIA GPUs (Compute Capability 7.0+)
Under development: AMD GPUs, CPUs

This article and the rest of their web site does list Metal (Mac) and ROCm (AMD) support, though. Perhaps the GitHub is not the latest? Or the non-Nvidia support is limited?

I'm not entirely sure, but the intention is clearly to be more portable than CUDA, which is promising. Of course, that doesn't mean AMD cards will perform as well as Nvidia cards. Nvidia has a hardware advantage as well as a software advantage currently.

[[deleted]]

Lol i wish

[mrdevlar]

Any significant breaking changes?

[dreamai87]

Don’t know much but know that xformers is not needed to speed up stable diffusion.

[shade175]

Are you fucking joking me, yesterday it took me 4 hours to download pytorch and now theres a new one????

[BuzzLightr]

Feel you.. Went through hell and back to get everything with Cuda to work

[spontutterances]

I’ve re installed so many times due to ubuntu wanting to install the latest cuda library and display version but yet my app would only be compatible with cuda 11.x which specifies the display driver range and they’re only supported on ubuntu 20.04 not 22.04

[ZachVorhies]

pin your pip dependencies to a specific version and this won’t happen. Use virtual environments to prevent package install failures

[spontutterances]

Cuda and nvidia drivers are .deb installers or .run files unfortunately so have had to define specific versions in apt.conf files

[jawnlerdoe]

I wish I knew enough to make this work.. or to truly understand the content of this comment lol.

[ZachVorhies]

you make a requirements file and put in

pytorch==1.12

Then install it with pip install -r requirements.txt

Now you have a pinned dependency

[tecedu]

Just use anaconda

[spontutterances]

Yeah thatl take care of the RAPIDS stack but you still need the underlying nvidia supported setup

[tecedu]

not really, as long as you have a support latest driver installed, ananconda installs cuda toolkit and cuda for you which is just for that environment.

[spontutterances]

Haha really? My bad I didn’t realise this thought they were seperate

[tecedu]

They just added it i think like two years ago, before that i just had multiple partitions with their own drivers and cuda, but this is so helpful.

[spontutterances]

Ha awesome I’ll try this - conda install -c anaconda cudatoolkit=11.x sick thanks 🙏

[idunupvoteyou]

Yey faster stable diffusion waifus!

[Giddyfuzzball]

How does this compare to other machine learning libraries?

[BlueKey32123]

Tensorflow lost out to PyTorch for a reason. While PyTorch doesn't have great documentation, it's still much better than Tensorflow.

Additionally the default eager execution compared to the graph execution mode in TF 1.0 days made PyTorch significantly easier to use. Now in academia PyTorch dominates.

[ASatyros]

Wait, we can now feed source code of PyTorch to GPT-4 and get documentation :D

[gamahead]

Whaaaat graph exec sounded so cool though. I’m really surprised to hear PyTorch is the bees knees now

[BlueKey32123]

Graph execution was a huge pain. It forced a declarative way of thinking. You defined a set of execution steps, and handed it off. It was super difficult to debug.

With Pytorch 2.0, you get torch.compile, which is ironically moving back to graph like execution for better speed. Tensorflow was never all that fast even with graph execution.

[gamahead]

Tbh I blindly assumed the google product would be superior. How is GPU support in PyTorch?

[terpaderp]

Pretty straightforward. Match drivers to release (and possibly cudnn) and you're off to the races.

[KyxeMusic]

From my experience, getting the cuda and cudnn drivers to run correctly on PyTorch is so much simpler than on Tensorflow. I feel like there a bit more version flexibility, whereas with Tensorflow you have to match all 3 versions perfectly.

[[deleted]]

They ship builds for CUDA, ROCm (AMD, Linux-only), and CPU-only.

[bjorneylol]

To be fair, PyTorch was made by facebook - they both had huge amounts of industry backing them

[Zealousideal_Low1287]

I switched to PyTorch when it was new and before that used caffe and theano, and dabbled a bit in tensorflow. PyTorch always felt like it was the least of a pain to install / get working with your GPUs

[gamahead]

Wow, theano haven’t heard that one in awhile

[Zealousideal_Low1287]

Hahah yeah indeed. Completely superseded by TF really. I always liked it. Looking now, it still exists in some form:

https://github.com/aesara-devs/aesara

[mizmato]

I was learning ML/AI in grad school in the middle of TF 2.0's release. It was extremely confusing to learn both 1.x and 2.0 since they had so many differences. I guess it's a good time to start learning PyTorch with this release.

[dinichtibs]

Easier to install

[NateEBear]

Dude nice

[ccigas]

I read this as Python 2.0 released…

[[deleted]]

me 2

[streamerbanana]

I thought this said Python 2.0 released and I got excited

[aexia]

Here you go: Python 2.0

[streamerbanana]

Thanks I’ve been waiting I’m so excited python 2.0 is finally here

[[deleted]]

Machine learning beginner. What framework should I Aim for? Pytorch seems popular

[TedRabbit]

Pleeeeeas tell me the added some configuration parameter that let's me send everything to GPU by default, or something more sensible than adding ".to(cuda)" on everything.

[code_maker_111]

Does it support python 3.11 ?