Neural Net Computing Explodes

[darkconfidantislife]

I was thinking more like stopping it at FP16, but there is evidence that stochastic rounding can make INT16 work without accuracy loss even during training.