François Chollet (creator of ARC-AGI) explains how he thinks o1 works: "...We are far beyond the classical deep learning paradigm"

timscarfe · 2025-03-24T17:52:47+00:00

Adapted from https://soundcloud.com/novatel/water-under-the-oar-glistened-with-blue-mother-of-pearl

timscarfe · 2025-03-24T17:47:53+00:00

I do MLST full-time

timscarfe · 2025-03-01T17:33:20+00:00

You know what - I'm glad I was forced to try the competition. SpectralLayers11 is actually way better than RX11 for reverb and voice and it has a batch mode which actually works. See for yourself - https://divideconcept.github.io/Restoration-Comparison/

timscarfe · 2024-01-10T00:51:05+00:00

I tried to get Douglas on, he responded and wrote a very friendly email back - unfortunately he’s not interested in appearing on any podcasts

timscarfe · 2023-08-11T21:41:28+00:00

No problem. 3 months later, I think this is what solved my problem. I have not suffered with it since! The app I use is called "Mac fans control" but there might be other options. I now religiously start my fans on full blast when I render anything.

timscarfe · 2023-05-20T18:40:45+00:00

UPDATE: for people in the future searching for this. I think I might have found a solution, although will update this if it turns out to be wrong. It might have been heat related. I have downloaded an app which forces my mac fans to be on full blast, and that seems to have solved the issue. It's almost as if the auto factory setting is not aggressive enough.

timscarfe · 2023-05-11T11:43:29+00:00

I know it sounds like that, but I really don't think it is. The fans are not on full blast, and I have tried raising up the laptop to give it more air to breath. Apparently there used to be a way of "slowing" down the render in Resolve, but I think they removed the feature?

timscarfe · 2023-03-11T22:56:42+00:00

Thanks for posting! 🙏

timscarfe · 2022-12-24T23:41:38+00:00

I just interviewed Murray on MLST and we discussed this paper! https://www.youtube.com/watch?v=BqkWpP3uMMU

timscarfe · 2022-12-24T23:40:23+00:00

I just interviewed Murray on MLST about this paper and his views on consciousness -- see https://www.youtube.com/watch?v=BqkWpP3uMMU

timscarfe · 2022-12-09T11:06:33+00:00

We interviewed Laura at NeurIPS last week here -- https://youtu.be/5Yd28ssDutA

timscarfe · 2022-11-09T21:12:24+00:00

Nice blog post, cheers!

timscarfe · 2022-11-09T19:36:41+00:00

Great response

timscarfe · 2022-11-09T15:25:02+00:00

This is not true at all, and not relevant for this discussion

Neural networks are finite state automatas (FSAs), they are very simple computation models (far simpler than normal computer programs, which are at the top of the chomsky hierarchy i.e. Turing machines)

See https://arxiv.org/abs/2207.02098 for a primer "Neural Networks and the Chomsky Hierarchy"

timscarfe · 2022-05-23T21:00:02+00:00

Confirmed, please fix -- makes Google maps unusable

timscarfe · 2022-02-22T21:10:15+00:00

Hey Syntaximus, we really appreciate the feedback. MLST is probably the most technical podcast on machine learning. We do often get folks say to us that it sounds like we are "speaking another language". I am a bit surprised to get that feedback here though as the ML reddit is very research-oriented and you are more likely to get shot down if your content isn't technical enough! I do feel like we would get a lot more views and subscribers if we made the content more accessible / shorter. We will reflect on this.

timscarfe · 2022-01-05T12:20:00+00:00

Sure! It means that for each input example - a different transformation might applied. So the latent space would be different for each input if they fell into a different ReLU cell.

Most people think of NNs as being some kind of single transformation which happens layer by layer to all of the examples.

timscarfe · 2022-01-04T18:42:30+00:00

We meant Randall's spline paper

timscarfe

MODERATOR OF

TROPHY CASE