Skip to content
conftrace_

preconditioned gradient descent

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

gradient descent (2) in-context learning (2) implicit optimization (1) overparameterized learning (1) feedforward neural network (1) noise adaptation (1) non-euclidean optimization (1) implicit linear regression (1) non-euclidean gradient (1) spectral descent (1)

Papers

Linear Transformers are Versatile In-Context Learners NeurIPS 2024 Mirror and Preconditioned Gradient Descent in Wasserstein Space NeurIPS 2024 The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing ICML 2023 Transformers learn to implement preconditioned gradient descent for in-context learning NeurIPS 2023 Communication-Efficient Distributed Optimization with Quantized Preconditioners ICML 2021 Preconditioned Spectral Descent for Deep Learning NeurIPS 2015