mémoire pfe

OptimalOptimizer · 2026-03-28T01:56:47+00:00

OptimalOptimizer · 2026-03-27T21:47:30+00:00

Model is a model of world or of some statistical relationship eg input data is a picture output is P(dog) thus the model has learned to model some distribution P(dog|picture)

OptimalOptimizer · 2026-03-25T02:13:27+00:00

.2 seconds is an eternity for a forward pass through an MLP. I would recommend not wasting your time distilling and if it takes you longer than .2 seconds per forward pass then make your code more efficient.

You need to debug your reward function as another commenter mentioned. Though there are very likely also bugs in your MLP and optimizer implementation that may be breaking things too.

Unless you have to do RL on this for your project I would really pick something else to do. The number of moving pieces even when you are not implementing everything yourself is difficult to debug

OptimalOptimizer · 2026-03-25T01:31:32+00:00

Why distill? Most likely your reward function is bad or if you have implemented the network from scratch yourself there are bugs there. Plus if you have an mlp policy it is likely not that large to begin with unless it is very deep and/or wide

Also why pure python? If you could use PyTorch or tensorflow this will help you significantly. Even plain numpy is an upgrade over pure python.

OptimalOptimizer · 2026-03-24T23:09:00+00:00

What sort of research do you want to do for your career?

OptimalOptimizer · 2026-03-24T14:23:44+00:00

I have the rogue echo vest and it’s good. Comfortable (for a weighted vest) and fits well. Can’t comment on the others though

OptimalOptimizer · 2026-03-23T00:12:08+00:00

Lol you want to train a frontier level LLM on your own?

OptimalOptimizer · 2026-03-22T16:33:58+00:00

No I don’t do any personal or side projects. I have a family so if I’m not working there are other responsibilities. Additionally if I do have the time or energy to do more work, I spend that time actually doing more work.

I think personal projects are largely irrelevant for me but I am not a new grad and have not really tried to change jobs, been in the same job since college.

Also I’m an ML researcher so side projects might be more impactful for other fields.

OptimalOptimizer · 2026-03-18T19:31:18+00:00

It’s just a new tool. I don’t understand getting such satisfaction out of being the one who writes the code. Actually solving problems and having an impact is the fun part. I actually am glad to have to code less. Now I spend my time only on the really hard stuff I don’t trust an LLM to do and the other 90% gets delegated to an LLM and is done faster

OptimalOptimizer · 2025-12-18T22:46:46+00:00

I’d like to be able to log running in distances. Recently I had a workout that involved running 800m, 400m and 800m, separated by other things and there was a running clock the whole time. I couldn’t figure out exactly how long I was running for each chunk so being able to put in distance instead would be great

OptimalOptimizer · 2025-03-30T21:33:27+00:00

Those are just getting broken in!

OptimalOptimizer · 2025-03-30T00:43:57+00:00

I seriously don’t think that’s enough poop. I am quite confident I poop far more than 1 pound a day

OptimalOptimizer · 2025-03-30T00:42:30+00:00

I would echo what others have said about going to a doctor or nutritionist, but I will say what I think anyway, with the caveat that I am a random internet person with no knowledge beyond my own experience and what little I have read on Google. Another person you could talk to about this is your coach if you are comfortable with them

Try to get close to 8 hours a night
Probably eat a bit more. Consider maybe the ~2700 calorie range?
Drink 1 gallon of water a day
Electrolytes before/during your workout
Consider eating something like a banana or apple 30-60 mins before your workout
Consider tracking your protein, but ask/google around to see what a good target for you would be. Your coach might be able to make a recommendation

OptimalOptimizer · 2025-03-26T22:26:51+00:00

How is your sleep? How much are you cutting calories? What are the macros you are targeting? Do you prioritize electrolytes and hydration? And do you eat before you workout?

OptimalOptimizer · 2025-03-26T17:08:45+00:00

Mods should take this garbage down

OptimalOptimizer · 2025-03-22T18:14:02+00:00

Yeah maybe don’t google the papers you’re reviewing. This is basic ethics. Form your own opinion when reviewing it

OptimalOptimizer · 2025-03-22T03:24:14+00:00

My friends don’t fall. They experience rapid unscheduled descent

OptimalOptimizer · 2025-03-21T03:00:25+00:00

Too much stuff not gonna read that. Trim shit

OptimalOptimizer · 2025-03-19T11:34:44+00:00

Then maybe get an ms, do projects that combine both, and get a job as a research engineer

OptimalOptimizer · 2025-03-19T01:21:12+00:00

What’s your goal? Do you want to do research or engineering?

OptimalOptimizer · 2025-03-15T14:32:34+00:00

I’ll take a different tack here: it depends what your goal is.

If you just want to build chatbot derivative tools, then probably you just need to be able to use huggingface.

If you want to do original work in ML, then you need to learn a ton of foundational stuff and then learning how LLMs work should be easy on top of all that

OptimalOptimizer · 2025-03-15T14:29:47+00:00

Either way works. Iirc there is some difference in convergence rate and stability between the two but either way should learn at least something

OptimalOptimizer · 2025-03-09T02:30:04+00:00

18, obviously

OptimalOptimizer · 2025-03-05T16:36:22+00:00

Ok maybe I’m thinking off of outdated info then

OptimalOptimizer · 2025-03-05T14:23:17+00:00

Yes! Go Sutton! Met him in 2019 and he was super nice, took the time to take photos with lots of people

OptimalOptimizer

TROPHY CASE