Skip to content
conftrace_

adaptive rate scaling

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

large batch training (1) layer-wise adaptive rate scaling (1) learning rate scaling (1) layer-wise scaling (1) learning rate warmup (1) convergence guarantee (1) learning rate (1) adaptive learning rate (1) gradient descent (1) neural network optimization (1)

Papers

Large Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling AAAI 2021