conftrace_

gradient descent dynamics

6 papers

Explore in graph

Co-occurring keywords

neural network (6616) infinite width limit (14) gradient descent (1144) loss landscape (149) neural tangent kernel (205) attention kernel (2) message passing algorithm (31) embedded ensemble (1) dropout ensemble (1) local minima (39)

Papers

Unraveling the Gradient Descent Dynamics of Transformers NIPS 2024
Towards Unbiased Exploration in Partial Label Learning JMLR 2024
Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022
Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes NIPS 2022
Tensor Programs IIb: Architectural Universality Of Neural Tangent Kernel Training Dynamics ICML 2021
Passed & Spurious: Descent Algorithms and Local Minima in Spiked Matrix-Tensor Models ICML 2019