conftrace_

k-fac

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

damping (1) learning rate selection (1) second-order lens (1) structured (1) inverse-free (1) kronecker factors (1) adam (1) mixed precision (1) natural gradient descent (1) regression (1)

Papers

Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC ICML 2024 Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens ICML 2024