conftrace_

adam-atan2

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

epsilon parameter (1) per-layer learning rate (1) parameterization (1) learning rate scaling (1) gradient underflow (1)

Papers

Scaling Exponents Across Parameterizations and Optimizers ICML 2024