conftrace_

layerwise adaptive learning rate

1 paper

Explore in graph

Also known as

LARS

Co-occurring keywords · papers mentioning both

batch size scaling (1) bert pretraining (1) large batch optimization (1) convergence analysis (1) stochastic optimization (1)

Papers

Large Batch Optimization for Deep Learning: Training BERT in 76 minutes ICLR 2020