conftrace_

preconditioned gradient descent

6 papers

Explore in graph

Co-occurring keywords

gradient descent (1144) in-context learning (1405) implicit optimization (2) overparameterized learning (7) noise adaptation (15) non-euclidean optimization (1) implicit linear regression (1) non-euclidean gradient (1) spectral descent (1) linear transformer (13)

Papers

Linear Transformers are Versatile In-Context Learners NIPS 2024
Mirror and Preconditioned Gradient Descent in Wasserstein Space NIPS 2024
The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing ICML 2023
Transformers learn to implement preconditioned gradient descent for in-context learning NIPS 2023
Communication-Efficient Distributed Optimization with Quantized Preconditioners ICML 2021
Preconditioned Spectral Descent for Deep Learning NIPS 2015