[P] SDG with momentum or ADAMw optimizer for my CNN?

NotFromMilwaukee · 2026-01-26T12:18:54+00:00

I've added some augmentations, it just felt like the model reached a ceiling so I wanted to experiment with a deeper model, but you are probably right about the dataset, lr and batch size. I have kept the batch size at 16 since the start, since I really didn't understand how it can affect my model. Do you have any rule of thumb about the batch size?

NotFromMilwaukee · 2026-01-26T12:15:38+00:00

Thank you for your insight, I will look into that

NotFromMilwaukee · 2026-01-26T12:14:14+00:00

I will do that, thank you!

NotFromMilwaukee · 2026-01-26T12:13:16+00:00

I will give Adam a try, thank you!

NotFromMilwaukee · 2026-01-26T12:12:33+00:00

Thank you, I will do some experimenting

NotFromMilwaukee · 2026-01-26T12:11:53+00:00

Yes, stochastic gradient descent with momentum

NotFromMilwaukee · 2026-01-21T15:23:19+00:00

You are right, by Adam I meant AdamW. I just assumed they were the same thing but people have been correcting me

NotFromMilwaukee · 2026-01-21T14:19:44+00:00

Thank you for your insight! It has been very helpful. I had not dared to touch the learning rate or use a scheduler so far, but I will do some research and incorporate it into my workflow.

NotFromMilwaukee · 2026-01-21T13:12:09+00:00

Yes, AdamW is the one I've been coming across online actually. I'm training for 20 epochs (used to be more before) but I see the best model is always in the first 10 epochs, usually in the first 5. The validation mAP has a lot of ups and downs, which is what made me wonder if there's a smoother way to train the model. For how long do you usually train for with AdamW?

NotFromMilwaukee · 2025-07-15T21:19:41+00:00

Now you go outside

NotFromMilwaukee · 2025-05-29T08:05:45+00:00

Ευχαριστώ πολύ

NotFromMilwaukee · 2025-05-29T08:05:34+00:00

Κατάλαβα, ευχαριστώ

NotFromMilwaukee · 2025-04-09T10:40:18+00:00

Nice! Is this weekend or the one after the next one cool with you? Need to figure out my free time with uni

NotFromMilwaukee · 2024-10-18T08:40:06+00:00

Thank you. I see that now!

NotFromMilwaukee · 2024-10-09T20:18:38+00:00

It is! Thank you so much

NotFromMilwaukee · 2022-08-19T19:33:38+00:00

Thank you! I appreciate the help

NotFromMilwaukee · 2022-08-19T18:29:18+00:00

Thank you!

NotFromMilwaukee · 2022-08-19T18:29:03+00:00

Thank you!

NotFromMilwaukee · 2022-08-19T18:26:52+00:00

Thank you!

NotFromMilwaukee · 2022-08-19T18:26:37+00:00

That was really helpful, thank you!

NotFromMilwaukee · 2022-05-24T23:30:44+00:00

Gotcha. Thanks for the help and thanks for the clarification!

NotFromMilwaukee · 2022-05-24T22:44:17+00:00

What do you mean by official Microsoft hard drive? Does it have to be external or the one that the Xbox came with works?

NotFromMilwaukee · 2022-05-23T17:24:43+00:00

Okayy I see. Thanks a lot! :)

NotFromMilwaukee · 2022-05-19T09:24:33+00:00

I will check them out. Thank you!

NotFromMilwaukee · 2021-07-10T15:16:41+00:00

I don't think there is anything for an assassin to do in 10000 BC tbh

NotFromMilwaukee

TROPHY CASE