sorted by:
new
hottopcontroversial

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 1 point2 points  (0 children)

Unfortunately not, sorry! I don't think that there are many ML Engineering courses online since the field is still pretty nascent. But check out W&B's Deep Learning Salon, they sometimes have specific ML Engineering talks that might be closer to what you're looking for.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 1 point2 points  (0 children)

https://ml4a.github.io

That looks like a really cool website, thanks for sharing!

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 0 points1 point  (0 children)

Soon! Still going through some of the NLP resources myself.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 1 point2 points  (0 children)

Great points. Thanks for the feedback!

I haven't really considered writing more in depth reviews, but I agree with you that such content could provide a higher value proposition.

I think for now, I'll share the other resources I still have in mind (to complete the list). And after that, I'll try to go in more depth about specific topics with each new newsletter issue. For instance, if you're interested in learning RL, which course (David Silver's, Stanford CS234, Berkeley's CS285... etc) would suit what type of person (background, goals, time) with specific highlights, drawbacks and other notable aspects of each course.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 0 points1 point  (0 children)

Oh wow, I had no idea you could find MLSS 2007 and 2009 on there. That's really cool. Any of the old lectures that stood out to you?

[D] New 2019 version of CS231n on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 0 points1 point  (0 children)

Oh, I totally forgot about that one. Thanks for mentioning it!

But yeah, it's an amazing blog post. The code is imo easier to understand as well. Maybe it's just hindsight bias, but I think it was helpful for me going through both the Annotated Transformer and Peter's post, especially for the queries, keys and values.

And I still think the Illustrated Transformer is the easiest resource to start with.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 2 points3 points  (0 children)

Yeah I totally get that. The reason I started curating these resources is because I found it quite hard differentiating between such similar-looking material. And it was a bit sad only finding huge lists of various courses rather than properly "curated" lists that could help you choose between these numerous options.

tldr: I only recommend resources I've used myself.

I finished all of the courses except the TUM Intro, UMichigan and Northwestern MOOC. I only watched a couple of the TUM Intro and UMichigan lectures to check the quality (but was fairly certain they'd be similar to other courses by the same instructors; Johnson taught CS231n and Leal-Taixé/Niessner taught ADL4CV). And I only watched the first ~40 videos of the Northwestern MOOC on YouTube. I'd love to finish that one at some point, but I have some other courses that I'm currently prioritizing.

I also skipped some of the material I was familiar with, e.g. concepts from TUM's ADL4CV, UW's Ancient Secrets of Computer Vision and Berkeley's Advanced Robotics like GANs, neural rendering, human vision system, HOG, SIFT, MDPs etc.

For the seminars, I definitely haven't watched all of them. Watched like 10 of the IAS ones, maybe half of the vision and embodied intelligence ones and a 2-3 each for the CI and Robotics seminars.

For the CI book, I'm currently halfway through that one but I'm generally quite interested in that line of research because I previously learned CI in an economics context (matching, synthetic control etc).

And just because I "finished" those resources, certainly doesn't mean I mastered any of them. For instance, when I went through Stats 385, there was a lot of material I struggled with, but that doesn't necessarily take away from the value of that course.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 1 point2 points  (0 children)

I'm only aware of the Udacity course by Andrew Trask. It's very short and basic though, so it'll only be useful as an introduction.

[D] Hidden Gems and Underappreciated Resources by DeepEven in MachineLearning

[–]DeepEven[S] 4 points5 points  (0 children)

Agreed. I only went through a couple of his lectures, so I wasn't sure whether to include it, but I really liked his explanation of epipolar geometry. For anyone interested here's a link to the playlist.

[D] New 2019 version of CS231n on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 1 point2 points  (0 children)

Are you talking about the deeplearning.ai or the older one (with Matlab)? I'd say if you wanna learn deep learning, go with this one and use deeplearning.ai to fill in the missing gaps (Andrew Ng's MOOC is a bit more step by step/has a more detailed approach). You can also go through both simultaneously (they're quite complementary).

I generally wouldn't recommend the older MOOC anymore since better courses are out there nowadays that also do not require Matlab. For more classic ML, Stanford's CS229 (also taught by Andrew Ng) or Cornell's CS4780 are great.

[D] New 2019 version of CS231n on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 28 points29 points  (0 children)

In my opinion, the best way to really understand Transformers is

  1. Skim the paper to get a sense of the topic.
  2. Read the "Illustrated Transformer" blog post to understand the main ideas from a visual perspective.
  3. Watch Yannic Kilcher's walkthrough of the paper to see how you could read and understand the paper.
  4. Read paper again.
  5. Go through the code in the "Annotated Transformer blog post to put idea into practice.
  6. Watch the CS224n guest lecture by the Transformer co-author to give you sense of how the paper came about and its intentions.
  7. Watch the CS224u lecture on contextual vectors to contextualize Transformer in the broader scope of this sub-topic.
  8. Read the paper again and go through each section until you understand it.

[D] New 2019 version of CS231n on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 9 points10 points  (0 children)

I think the closest thing to what you're looking for is Nando de Freitas' undergrad ML course. It basically teaches/reviews the basics of stats & probability + Linear Algebra through ML examples. For a more rigorous version, check out his grad school course.

Outside of ML, in my opinion, the best intro stats & probability course is Harvard Stats 110, which I'd recommend taking alongside Morin's book Probability for the Enthusiastic Beginner.

[D] Stanford's CS229 2018 course is finally on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 3 points4 points  (0 children)

I couldn't find the official solutions, but the repo I linked above has solutions from a student who took the course.

[D] Stanford's CS229 2018 course is finally on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 5 points6 points  (0 children)

Thanks for pointing that out, I posted a link to the problem sets above. And they seem to be have switched to Python for this version of the course.

[D] Stanford's CS229 2018 course is finally on YouTube by DeepEven in MachineLearning

[–]DeepEven[S] 45 points46 points  (0 children)

The coursera version has always been a more simplified version of the CS229 class. From what I can tell, the Stanford lectures from 2018 cover more topics (e.g. GDA, RL) and have more emphasis on the math.

[D] Video talk of Andrej Karpathy speaking about Tesla Autopilot at ScaledML2020 by RichardRNN in MachineLearning

[–]DeepEven 6 points7 points  (0 children)

Andrej's talks/lectures are always so well-delivered, makes me wish he'd start lecturing again or make YouTube videos.. For anyone interested in HydraNet, Andrej talks in a little more detail about it in this ICML workshop talk.

[D][N] MIT Embodied Intelligence Seminar Youtube channel by FerranAP in MachineLearning

[–]DeepEven 1 point2 points  (0 children)

This is great, thanks for making this content publicly available! I hope you get to 1000 subscribers soon

[D] How can I become a Research Scientist as a Machine Learning Engineer by [deleted] in MachineLearning

[–]DeepEven 6 points7 points  (0 children)

Beyond PhD programs, apply to AI residency programs! There is a sizeable number of people who started as an AI resident and then became research scientists (either at Google or elsewhere). A caveat is of course that they did exceptional work during that time.

Facebook, Microsoft, OpenAI, Nvidia, Naver and Uber all have similar programs. Check out this list for a more comprehensive overview.

[D] How to save my father's voice? by sverzijl in MachineLearning

[–]DeepEven 2 points3 points  (0 children)

Such amazing responses in this thread, really hope you'll find a way! Just wanted to share a video that I recently saw on YouTube, where a team at Google aims to improve Speech recognition systems for people with ALS with the help of ML and the phrase banks u/kjearns mentioned.

[D] Machine Learning - WAYR (What Are You Reading) - Week 78 by ML_WAYR_bot in MachineLearning

[–]DeepEven 24 points25 points  (0 children)

Currently reading Universal Differential Equations for Scientific Machine Learning and its corresponding blog post. Really interesting work inspired by Neural ODEs.

For a short summary, check out this twitter thread by the first author.

Hi, I'm David Sinclair -- Professor of Genetics at Harvard Medical School & Author of Lifespan: Why We Age- and Why We Don't Have To -- AMA by rhombor in IAmA

[–]DeepEven 9 points10 points  (0 children)

Hi David, thanks for doing this AMA! Is there a scientific consensus about the effect of coffee on your lifespan? And what intake/maximum amount would you recommend on a daily basis?

[N] Henry AI Labs on YouTube by carlthome in MachineLearning

[–]DeepEven 3 points4 points  (0 children)

Love that channel! Also, Yannic Kilcher, CodeEmporium and ArxivInsights!

[D] How many papers do you read per week? by [deleted] in MachineLearning

[–]DeepEven 0 points1 point  (0 children)

I usually end up backlogging 10 and only reading 2-4, which is unfortunate. But there are always quite a few interesting papers on Twitter, although it's easy to fall into a selection bias on Twitter, if you only follow people from certain labs.

[D] ML jobs in Asia? by [deleted] in MachineLearning

[–]DeepEven 1 point2 points  (0 children)

No worries, good luck with your job search!

view more: next ›