conftrace_

per-layer learning rate

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

adam-atan2 (1) epsilon parameter (1) parameterization (1) learning rate scaling (1) gradient underflow (1)

Papers

Scaling Exponents Across Parameterizations and Optimizers ICML 2024