conftrace_

teacher-student setup

4 papers

Explore in graph

Co-occurring keywords

neural network (6616) stochastic gradient descent (1091) spurious feature (17) accuracy degradation (4) bias dynamics (1) bias formation (2) shallow neural network (18) activation function (133) quadratic activation (7) control theory (31)

Papers

On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions AISTATS 2024
Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training NIPS 2024
Attacks on Online Learners: a Teacher-Student Analysis NIPS 2023
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup NIPS 2019