NVIDIA Interview Question
How does batch normalization improve training of neural networks?
Interview Answer
Anonymous
Mar 11, 2019
- gradients on any given layer don't dominate other layers and hide their effects - faster convergence because gradients are on similar scale, so weights are also on similar scale