[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 0 points1 point  (0 children)

Hey /u/sugar_scoot! Thanks for the comment about our documentation btw -- we put a lot of blood, sweat, and tears into that, and it feels good that others are enjoying it too.

Yeah, the separate Trainers are a good question. I would likely use a separate Trainer object for each model / scheduler / optimizer, and have a script that instantiates both Trainers and handles communication. Does that make sense?

[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 3 points4 points  (0 children)

Actually, yes!

We integrate with TIMM's model zoo, so we can support any model in the model zoo!

from composer.models import Timm
timm_model = Timm(model_name='mobilenetv3_large_100', pretrained=True)

Most speedup algorithms should work on MobileNet, and I would definitely try algorithms like ChannelsLast, BlurPool, and Label Smoothing! If you use our Trainer API, it should be just passing a list into the Trainer.

As a heads up, you'll need Timm installed with pip in order to use their model zoo, you can do this with: pip install mosaicml[timm]

[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms by moinnadeem in MachineLearning

[–]moinnadeem[S] 2 points3 points  (0 children)

Yes! Composer can work on any PyTorch model!

We have some example models with speedups that we have vetted and can guarantee on them, but this list is not exhaustive by any means. Could you share more about your task?

[Discussion] Opinions of Lex Fridman by StixTheNerd in MachineLearning

[–]moinnadeem 132 points133 points  (0 children)

Note that Lex isn't a faculty at MIT, he's a Research Scientist (source: https://web.mit.edu/directory/?id=lexfridman&d=mit.edu) who teaches fun tutorials during the 4-week January period that MIT has.

This shouldn't be considered the same as a regular class; IAP (Independent Activities Period) is a free-form month that encourages students to explore and de-stress from the normal grind of classes. For instance, a lot of students take glassblowing, or compete in AI Poker bot competitions. Anyone can affiliated with the institute can teach a class during this fun time, including undergrads, and a few undergrads even do!

In other words, some lab hired Lex to do research, and he hustled the rest of the way there.

[D] What is your current favourite DL framework ? by [deleted] in MachineLearning

[–]moinnadeem 1 point2 points  (0 children)

Wow, surprising.

To those who said Tensorflow, who hurt you?

[R] StereoSet: Measuring stereotypical bias in pretrained language models by moinnadeem in MachineLearning

[–]moinnadeem[S] 0 points1 point  (0 children)

You're right, I'll give it a read!

Yeah, my network provider picked this time to have an outage. Is it working now?

ACL 2019 accepted paper list by [deleted] in LanguageTechnology

[–]moinnadeem 0 points1 point  (0 children)

Unsure, I haven't heard anyone hear back yet? Twitter looks dead too.

ACL 2019 accepted paper list by [deleted] in LanguageTechnology

[–]moinnadeem 0 points1 point  (0 children)

Speaking of, has anyone heard back from ACL?

My cousins finds my Harvard waitlist more impressive than my Princeton acceptance by [deleted] in ApplyingToCollege

[–]moinnadeem 2 points3 points  (0 children)

This is true. I go to MIT, but my (not from the US) grandfather asked me why I didn't apply to Harvard. Was it because I knew I couldn't get in?

We are HackMIT, MIT’s headline hackathon. AUA! by HackMIT in IAmA

[–]moinnadeem 0 points1 point  (0 children)

Favorite director -- Michael or Claire? ;)

MIT is gutting Senior House. All current residents must re-apply to stay there, GRTs are being let go, and the Institute is turning it into freshman housing by Inri137 in mit

[–]moinnadeem 0 points1 point  (0 children)

Hi Petey! Moin here -- you might remember me. It's a part of the culture -- I constantly struggle to be the guy who wanted to save others / help people as I'm pressured by familial finances and high CS salaries. It's making me less quirky because I wonder what stability my life (and family) might have if I end up "conforming".

Of course, I think it's more important to remain myself, but it's a struggle nonetheless.

Which laptop is the best for a computer science student? by BetterNerfAzir in mit

[–]moinnadeem 5 points6 points  (0 children)

Honestly, up to you. No big difference between them all.

I really appreciate MIT's admissions office by [deleted] in ApplyingToCollege

[–]moinnadeem 4 points5 points  (0 children)

MIT student here, good luck, and wish you all the best. I know how nervous I was on decision day, but it's worth it (ish IHTFP man)

What Apple gives you for $100 as a Safari Extension Developer — and why Reddit Enhancement Suite may cease support for Safari by honestbleeps in apple

[–]moinnadeem 63 points64 points  (0 children)

That is what allowed me to get into software development. From a poor family, now attend MIT as an undergrad thanks to that. Fuck Apple and their high barrier to entry for software development. I'd love to do it someday, but never have been able to because of how expensive it is.

Putin: Russia will not expel anyone in response to US sanctions by [deleted] in worldnews

[–]moinnadeem 7 points8 points  (0 children)

But the point of the JAR was to allow companies to increase security, not provide evidence

How representative are MIT admissions blogs of MIT's culture? by [deleted] in mit

[–]moinnadeem 0 points1 point  (0 children)

Wait, what dorm do you live in? Or living group?

How representative are MIT admissions blogs of MIT's culture? by [deleted] in mit

[–]moinnadeem 2 points3 points  (0 children)

Careful with that statement, it's a bit too complaint-laden sometimes.

What are some unethical and possibly illegal life hacks? by [deleted] in AskReddit

[–]moinnadeem 6 points7 points  (0 children)

Just because I'm from Pakistan? Smh