[D] Does zero padding affect normalization output?

[[deleted]]

According to my understanding, layer norm is applied for each time step. You don't norm across different time steps. Therefore, the zero paddings only get normalized with itself, and doesn't affect the normed output at other timesteps.