conftrace_

over-parameterized model

20 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) implicit regularization (93) gradient descent (1144) global convergence (111) neural network (6616) deep neural network (1803) convergence rate (607) importance weighting (59) neural network optimization (1293) statistical learning theory (82)

Papers

Toward Global Convergence of Gradient EM for Over-Paramterized Gaussian Mixture Models NIPS 2024
Gibbs-Based Information Criteria and the Over-Parameterized Regime AISTATS 2024
Benign Overfitting in Adversarially Robust Linear Classification UAI 2023
A Unified Approach to Controlling Implicit Regularization via Mirror Descent JMLR 2023
Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models NIPS 2023
Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models NIPS 2023
Rethinking Gauss-Newton for learning over-parameterized models NIPS 2023
The alignment property of SGD noise and how it helps select flat minima: A stability analysis NIPS 2022
UMIX: Improving Importance Weighting for Subpopulation Shift via Uncertainty-Aware Mixup NIPS 2022
Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks JMLR 2022
Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence AISTATS 2021
Failures of Model-dependent Generalization Bounds for Least-norm Interpolation JMLR 2021
Training Over-parameterized Models with Non-decomposable Objectives NIPS 2021
SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs NIPS 2021
Good Classifiers are Abundant in the Interpolating Regime AISTATS 2021
Rethinking Bias-Variance Trade-off for Generalization of Neural Networks ICML 2020
Implicit Regularization of Discrete Gradient Dynamics in Linear Neural Networks NIPS 2019
What is the Effect of Importance Weighting in Deep Learning? ICML 2019
Fast and Faster Convergence of SGD for Over-Parameterized Models and an Accelerated Perceptron AISTATS 2019
On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport NIPS 2018