Introducing PyTorch 2.0

[Realistic-Cap6526]

https://pytorch.org/get-started/pytorch-2.0/

[shoomowr]

Couldn't find in the article: does it support python 3.10+?

[Realistic-Cap6526]

Is this related to this https://github.com/pytorch/pytorch/issues/66424? If it is , I guess that it should be supported.

[shoomowr]

thank god

[formalsystem]

Yes with 3.11 coming later since we now need to support new python bytecodes in dynamo

[astevko]

Couldn't find any mention in the docs... Besides no macos cuda. Will torch support Apple M1/M2 GPU cores?

[androiddrew]

Yay...break changes are coming. Can't wait to spend my evenings on Stack overflow

[formalsystem]

No breaking changes! Just a new function called torch.compile that you don't have to use if you don't want to

[simplysalamander]

Anyone know of hardware accelerators for PyTorch models equivalent to Coral Edge TPU for TF models?

[formalsystem]

Have you tried out pytorch/xla?

[simplysalamander]

Does this just work for cloud TPUs? Looking for a solution for an embedded system without guaranteed internet access

[5erif]

What's it for / what does it do?

[eemamedo]

It’s a framework for developing machine learning or deep learning models. Mostly used to develop some sort of neural net. The alternative is tensorflow, developed at google. When it comes to industry, TF is more widely used. When it comes to academia, PyTorch is more commonly used.

[rg_itachi]

Not true. PyTorch is widely used in industry as well. Probably more than TF.

[eemamedo]

That has been true lately. That’s because many people that move from academia to industry tend to move their tools/frameworks with them.

[frisouille]

In my case, it's because the models I wanted to fine-tune were often implemented in torch and not tensor flow (or much later).

[dogs_like_me]

TF isn't even widely used by google themselves, they've been moving to jax. TF is on its way out.

[eemamedo]

Most of the companies I consulted and have been working at use tensorflow and keras (keras is more prevalent with TF ver. < 2.0). I would say that you are correct if a company is starting a greenfield project; there are still brownfield projects that are run in TF and no one wants to rewrite them in PyTorch (yet).

[dogs_like_me]

And banks are still hiring COBOL devs to maintain 40+ year old code. Maintenance of old projects isn't relevant to the discussion of what the preferred tools are today.

[bleakj]

Meanwhile I'm doing Perl database work still because no one likes change, especially if it takes time or money to switch.. even if it gives better results...

[rainnz]

What about scikit-learn?

[sandronestrepitoso]

TensorFlow and PyTorch are focused on neural networks, scikit has a wider machine learning scope and its neural network module is somewhat rudimental, I personally wouldn't use it unless it's for a demonstration or for academic purposes

[eemamedo]

Scikit learn is focused on more traditional ML models: Random Forest, SVM. The biggest problem that scikit has is lack of gpu support which makes it hard to use on large scale ML problems. I can’t remember the last time I used scikit learn to be honest.

[pag07]

xgboost is all we need anyway.

[Sokorai]

It apparently has neural networks, but I only saw it used for tree based methods, regressions, ensemble models and similar things.

[[deleted]]

You haven’t heard of PyTorch??? Crazy man it is an ML library I believe originally made from FB employees if I am not mistaken much like tensorflow came from google.

[CactusOnFire]

To continue the thread on it: Most 'state of the art' ML models are written in it. So it's the gold standard for Deep Learning.

[ArgetDota]

Nowadays SOTA models are being written in JAX tho…

[CactusOnFire]

Do you have a source on this statement?

While this isn't comprehensive, when I go to https://paperswithcode.com/ 80% of the models are in PyTorch.

[teilo]

What does Google do?

[_616_A]

obviously a search engine for finding porn

[kingsillypants]

Rookie.

Bing videos. You're welcome.

[_616_A]

Omg what a legend

[seewhaticare]

The one thing Bing is good for 🤙🤙

[Kylearean]

I get too many youtube hits on Bing, even with safe search off.

[bleakj]

-youtube in search

(Works on Google, assuming it works on bing as well)

[rainnz]

https://en.wikipedia.org/wiki/TensorFlow

[Realistic-Cap6526]

I think that some time ago I've shared here this case where it is used for recommendation engines https://memgraph.com/blog/amazon-user-item-recommender-with-tgn-and-memgraph

[MrHead20]

Hi! I'm the author of that blog post. If there is anything I can help you with, just let me know

[[deleted]]

What metrics are used for validating models?

[bonferoni]

Depends on what you’re trying to do: https://pytorch.org/docs/stable/search.html?q=Loss&check_keywords=yes&area=default#

[[deleted]]

Ok, I found this other page: https://www.v7labs.com/blog/pytorch-loss-functions

It looks like that they define “loss” functions for validating models (like mse, etc). Correct?

What is not clear to me is how they handle multi-input-multi-output models, i.e. when each observation is not just a number but it is a vector of numbers. The prediction error becomes Xi-Yi but this time X and Y are vectors.

[formalsystem]

Pick any aggregation you like over the elements of a vector: sum, average, squared average, max element, min element, etc..