conftrace_

structured

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

kronecker factors (1) diagonal (1) inverse-free (1) kronecker-factored (1) k-fac (1) preconditioners (1) layer-wise (1) mixed precision (1) adaptive optimization (1) natural gradient descent (1)

Papers

Structured Preconditioners in Adaptive Optimization: A Unified Analysis ICML 2025 Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC ICML 2024