conftrace_

overparameterized neural network

21 papers

Explore in graph

Co-occurring keywords

neural tangent kernel (205) gradient descent (1144) stochastic gradient descent (1091) generalization bound (652) early stopping (76) local sgd (17) neural network (6616) streaming datum (77) convergence rate (607) generalization error (285)

Papers

Overparametrized Multi-layer Neural Networks: Uniform Concentration of Neural Tangent Kernel and Convergence of Stochastic Gradient Descent JMLR 2024
The effect of Leaky ReLUs on the training and generalization of overparameterized networks AISTATS 2024
Symmetries in Overparametrized Neural Networks: A Mean Field View NIPS 2024
FedAvg Converges to Zero Training Loss Linearly for Overparameterized Multi-Layer Neural Networks ICML 2023
Explicit Regularization in Overparametrized Models via Noise Injection AISTATS 2023
Provably and Practically Efficient Neural Contextual Bandits ICML 2023
Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time AISTATS 2022
Regularization Matters: A Nonparametric Perspective on Overparametrized Neural Network AISTATS 2021
A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks AISTATS 2021
One-pass Stochastic Gradient Descent in overparametrized two-layer neural networks AISTATS 2021
The Dynamics of Gradient Descent for Overparametrized Neural Networks L4DC 2021
Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances ICML 2021
DebiNet: Debiasing Linear Models with Nonlinear Overparameterized Neural Networks AISTATS 2021
**Paper retracted by author request (see pdf for retraction notice from the authors)** Nonparametric Regression with Shallow Overparameterized Neural Networks Trained by GD with Early Stopping COLT 2021
Small Data, Big Decisions: Model Selection in the Small-Data Regime ICML 2020
On the Similarity between the Laplace and Neural Tangent Kernels NIPS 2020
Gradient Descent with Early Stopping is Provably Robust to Label Noise for Overparameterized Neural Networks AISTATS 2020
Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks ICML 2019
Convergence of Adversarial Training in Overparametrized Neural Networks NIPS 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers NIPS 2019
Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data NIPS 2018