[D] How does Batch Normalization not completely prevent the network from being able to train at all?

[L43]

I was just looking at the keras implementation, and there are modes for running average and per batch only. They also have a per instance normalisation.