conftrace_

cosine decay

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

adamw optimizer (1) compute optimization (1) large language model (1) learning rate schedule (1)

Papers

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs ICLR 2025