conftrace_

adam algorithm

2 papers

Explore in graph

Also known as

ADAM

Co-occurring keywords · papers mentioning both

unbounded smoothness (1) transformer model (1) decentralized training (1) communication topology (1) gradient clipping (1) distributed learning (1) non-convex optimization (1)

Papers

From Promise to Practice: Realizing High-performance Decentralized Training ICLR 2025 Robustness to Unbounded Smoothness of Generalized SignSGD NeurIPS 2022