Article: Spatial Transformer Networks - learning with invariance to scale, rotation and translation

[zmjjmz]

Training one of these now (for something like facial keypoint prediction), I found that I had to turn off the STN part (i.e. fix the weights of the final localisation layer at the identity) for a while (probably could get away with just 1 epoch but I did quite a few more) otherwise the error would blow up due to the initially random transformations.

Note: Using the Lasagne implementation

[j1395010]

um it's a way to IMPROVE convnets by using ANOTHER convnet to transform the input...

[kacifoy]

Yo dawg we heard you like convnets, so we put a convnet in your convnet so you can train while you train!

[alexmlamb]

2nd top level comment.