conftrace_

ema timescale

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

mup (1) adamw (1) learning rate scaling (1) exponential moving average (1) weight decay (1)

Papers

How to set AdamW’s weight decay as you scale model and dataset size ICML 2025