Skip to content
conftrace_

adamw optimizer

3 papers

Explore in graph

Also known as

ADAMW

Co-occurring keywords · papers mentioning both

neural network optimization (2) structure-aware optimization (1) cosine decay (1) compute optimization (1) embedding optimization (1) critical batch size (1) graph neural network (1) large language model (1) optimizer design (1) structure-aware learning (1)

Papers

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs ICLR 2025 Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training NeurIPS 2024 Graph-enhanced Optimizers for Structure-aware Recommendation Embedding Evolution NeurIPS 2024