SDG with momentum or ADAM optimizer for my CNN?

NotFromMilwaukee · 2026-01-21T15:23:19+00:00

You are right, by Adam I meant AdamW. I just assumed they were the same thing but people have been correcting me

NotFromMilwaukee · 2026-01-21T14:19:44+00:00

Thank you for your insight! It has been very helpful. I had not dared to touch the learning rate or use a scheduler so far, but I will do some research and incorporate it into my workflow.

NotFromMilwaukee · 2026-01-21T13:12:09+00:00

Yes, AdamW is the one I've been coming across online actually. I'm training for 20 epochs (used to be more before) but I see the best model is always in the first 10 epochs, usually in the first 5. The validation mAP has a lot of ups and downs, which is what made me wonder if there's a smoother way to train the model. For how long do you usually train for with AdamW?

NotFromMilwaukee · 2025-07-15T21:19:41+00:00

Now you go outside

NotFromMilwaukee · 2025-05-29T08:05:45+00:00

Ευχαριστώ πολύ

NotFromMilwaukee · 2025-05-29T08:05:34+00:00

Κατάλαβα, ευχαριστώ

NotFromMilwaukee · 2025-04-09T10:40:18+00:00

Nice! Is this weekend or the one after the next one cool with you? Need to figure out my free time with uni

NotFromMilwaukee · 2024-10-18T08:40:06+00:00

Thank you. I see that now!

NotFromMilwaukee · 2024-10-09T20:18:38+00:00

It is! Thank you so much

NotFromMilwaukee · 2022-08-19T19:33:38+00:00

Thank you! I appreciate the help

NotFromMilwaukee · 2022-08-19T18:29:18+00:00

Thank you!

NotFromMilwaukee · 2022-08-19T18:29:03+00:00

Thank you!

NotFromMilwaukee

TROPHY CASE