A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks

Behrad Moniri; Donghwan Lee; Hamed Hassani; Edgar Dobriban

2024 ICML ICML 2024

A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Behrad Moniri, Donghwan Lee, Hamed Hassani, Edgar Dobriban

Topics

Machine Learning > Optimization & Theory > Learning Theory Machine Learning > Optimization & Theory > Theory Deep Learning > Architectures > Neural Networks

Keywords

gradient descent polynomial feature feature matrix rank-one component spectrum spike

Download PDF