conftrace_

lion

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

adamw (2) accelerated √l_p steepest descent (1) interpolated primal-dual iterate sequences (1) non-euclidean smooth optimization (1) shampoo (1) sgd (1) gpt2 (1) preconditioned gradient (1) variance reduction (1)

Papers

MARS: Unleashing the Power of Variance Reduction for Training Large Models ICML 2025 Stacey: Promoting Stochastic Steepest Descent via Accelerated ℓ_p-Smooth Nonconvex Optimization ICML 2025