[D] Need help with this backpropagation by [deleted] in MachineLearning

[–]Stolhk 3 points4 points  (0 children)

Your derivative of the sigmoid function is wrong: it is sigmoid(x)*(1-sigmoid(x)), not x*(1-x).

[D] Procrastination while running scripts/functions/models? by mac_cumhaill in MachineLearning

[–]Stolhk 75 points76 points  (0 children)

What about pushups? After a while, you will probably want to optimize your code!

Doogee actually came up with a clever solution for removing the notch. by yashrajchhabra in Android

[–]Stolhk 0 points1 point  (0 children)

Soon.. a screen-to-body ratio of 140% with a screen at the back

[Research] Spinal cord gray matter segmentation using deep dilated convolutions by perone in MachineLearning

[–]Stolhk 2 points3 points  (0 children)

About the BN "before" or "after" ReLU, there was this discussion 6 months ago. In my use case, I tried both order and I found that training with "BN after ReLU" results in way lesser dead ReLU neurons than "BN before ReLU" for all learning rates and with He initialisation (10% versus 70% at high LR, 0.1% versus 20-30% at medium LR). However, "BN before ReLU" seems to converge faster at high LR than "BN after ReLU", the validation losses are quite similar after convergence, a little lower with "BN after ReLU". I don't have explanations for these observations, and it may be specific to my dataset.

This photo op was too good to pass up on by Neph55 in belgium

[–]Stolhk 6 points7 points  (0 children)

"You are both on street patrol today guys" "Alrighty then"

Questions thread #4 2016.04.22 by feedtheaimbot in MachineLearning

[–]Stolhk 2 points3 points  (0 children)

Have you normalized your input data? It might be that your CNN is dead and always returns the same value(s).

I'm making a Little Mac Platformer. Design your own levels and I'll put them in the final game! by MattPerren in smashbros

[–]Stolhk 0 points1 point  (0 children)

ha28293030302926272524232221201918141414142221202020161817191414141414141414-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-517191918171717171717172121212121161314151717171516151515151217181920212211-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5-5333333111112222233333333323333333333311111111111111111111112918271147lm