conftrace_

epsilon parameter

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

adam-atan2 (1) per-layer learning rate (1) parameterization (1) learning rate scaling (1) gradient underflow (1)

Papers

Scaling Exponents Across Parameterizations and Optimizers ICML 2024