LoRA Training in the NTK Regime has No Spurious Local Minima

Uijeong Jang; Jason D. Lee; Ernest K. Ryu

2024 ICML ICML 2024

LoRA Training in the NTK Regime has No Spurious Local Minima

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Uijeong Jang, Jason D. Lee, Ernest K. Ryu

Topics

Machine Learning > Optimization & Theory > Neural Network Optimization Machine Learning > Learning Types > Transfer Learning Artificial Intelligence > Core AI > Large Language Models

Keywords

neural tangent kernel gradient descent low-rank solution spurious local minima lor a ntk regime

Download PDF