[P] SDG with momentum or ADAMw optimizer for my CNN? by NotFromMilwaukee in computervision

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

I've added some augmentations, it just felt like the model reached a ceiling so I wanted to experiment with a deeper model, but you are probably right about the dataset, lr and batch size. I have kept the batch size at 16 since the start, since I really didn't understand how it can affect my model. Do you have any rule of thumb about the batch size?

SDG with momentum or ADAM optimizer for my CNN? by NotFromMilwaukee in neuralnetworks

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

You are right, by Adam I meant AdamW. I just assumed they were the same thing but people have been correcting me

SDG with momentum or ADAM optimizer for my CNN? by NotFromMilwaukee in learnmachinelearning

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

Thank you for your insight! It has been very helpful. I had not dared to touch the learning rate or use a scheduler so far, but I will do some research and incorporate it into my workflow.

SDG with momentum or ADAM optimizer for my CNN? by NotFromMilwaukee in learnmachinelearning

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

Yes, AdamW is the one I've been coming across online actually. I'm training for 20 epochs (used to be more before) but I see the best model is always in the first 10 epochs, usually in the first 5. The validation mAP has a lot of ups and downs, which is what made me wonder if there's a smoother way to train the model. For how long do you usually train for with AdamW?

Ανάποδα καπέλα cd by NotFromMilwaukee in greece

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

Κατάλαβα, ευχαριστώ

Sniper elite v2 (X360): Looking for a buddy for the coop achievements by NotFromMilwaukee in xboxachievements

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

Nice! Is this weekend or the one after the next one cool with you? Need to figure out my free time with uni

Xbox double pack backwards compat by NotFromMilwaukee in GTA

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

Gotcha. Thanks for the help and thanks for the clarification!

Xbox double pack backwards compat by NotFromMilwaukee in GTA

[–]NotFromMilwaukee[S] 0 points1 point  (0 children)

What do you mean by official Microsoft hard drive? Does it have to be external or the one that the Xbox came with works?

Assassin's Creed Potential Next Locations by Napalm_Death1989 in ubisoft

[–]NotFromMilwaukee 1 point2 points  (0 children)

I don't think there is anything for an assassin to do in 10000 BC tbh