conftrace_

matrix eigen-decomposition

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

second moment (1) preconditioning method (1) language model pretraining (1) eigenvalue computation (1) optimization algorithm (1) manifold optimization (1) stochastic gradient (1) riemannian optimization (1)

Papers

SOAP: Improving and Stabilizing Shampoo using Adam for Language Modeling ICLR 2025 Matrix Eigen-decomposition via Doubly Stochastic Riemannian Optimization ICML 2016