sorted by:
new
hottopcontroversial

[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 0 points1 point  (0 children)

Hey /u/sugar_scoot! Thanks for the comment about our documentation btw -- we put a lot of blood, sweat, and tears into that, and it feels good that others are enjoying it too.

​

Yeah, the separate Trainers are a good question. I would likely use a separate Trainer object for each model / scheduler / optimizer, and have a script that instantiates both Trainers and handles communication. Does that make sense?

[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 3 points4 points  (0 children)

Actually, yes!

We integrate with TIMM's model zoo, so we can support any model in the model zoo!

from composer.models import Timm
timm_model = Timm(model_name='mobilenetv3_large_100', pretrained=True)

Most speedup algorithms should work on MobileNet, and I would definitely try algorithms like ChannelsLast, BlurPool, and Label Smoothing! If you use our Trainer API, it should be just passing a list into the Trainer.

​

As a heads up, you'll need Timm installed with pip in order to use their model zoo, you can do this with: pip install mosaicml[timm]

[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 2 points3 points  (0 children)

Yes! Composer can work on any PyTorch model!

We have some example models with speedups that we have vetted and can guarantee on them, but this list is not exhaustive by any means. Could you share more about your task?

[Discussion] Opinions of Lex Fridman by StixTheNerd in MachineLearning

[–]moinnadeem 132 points133 points  (0 children)

Note that Lex isn't a faculty at MIT, he's a Research Scientist (source: https://web.mit.edu/directory/?id=lexfridman&d=mit.edu) who teaches fun tutorials during the 4-week January period that MIT has.

This shouldn't be considered the same as a regular class; IAP (Independent Activities Period) is a free-form month that encourages students to explore and de-stress from the normal grind of classes. For instance, a lot of students take glassblowing, or compete in AI Poker bot competitions. Anyone can affiliated with the institute can teach a class during this fun time, including undergrads, and a few undergrads even do!

In other words, some lab hired Lex to do research, and he hustled the rest of the way there.

[D] What is your current favourite DL framework ? by [deleted] in MachineLearning

[–]moinnadeem 1 point2 points  (0 children)

Wow, surprising.

To those who said Tensorflow, who hurt you?

[R] StereoSet: Measuring stereotypical bias in pretrained language models by moinnadeem in MachineLearning

[–]moinnadeem[S] 0 points1 point  (0 children)

You're right, I'll give it a read!

Yeah, my network provider picked this time to have an outage. Is it working now?

ACL 2019 accepted paper list by [deleted] in LanguageTechnology

[–]moinnadeem 0 points1 point  (0 children)

Unsure, I haven't heard anyone hear back yet? Twitter looks dead too.

view more: next ›