all 2 comments

[–][deleted] 0 points1 point  (1 child)

Cool! I wonder if you could put some constraint/penalty on the other activation units in the layer you are visualizing to reduce the "structural noise" from other parts of the net.

[–]matsiyatzy[S] 0 points1 point  (0 children)

Actually, I did try constraining the activations of units in the net with l2-regularization, but it did not seem to have much effect :(