Skip to content
conftrace_

warmup schedule

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

learning rate warmup (2) adam optimizer (2) learning rate (2) variance rectification (1) speech-to-text model (1) variance analysis (1) adaptive gradient (1) transformer optimization (1) model convergence (1) adaptive optimization (1)

Papers

The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergence ACL 2025 On the Adequacy of Untuned Warmup for Adaptive Optimization AAAI 2021 On the distributional properties of adaptive gradients UAI 2021