batch size schedule

batch size (1) transformer model (1) batch size scheduling (1) chinchilla-optimal language model (1) gradient noise scale (1) per-example gradient (1) layer normalization (1) transformer training (1) neural network optimization (1)