← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Learning-Rate-Free Learning by D-Adaptation ICML 2023
Generalized Polyak Step Size for First Order Optimization with Momentum ICML 2023
On Single-Index Models beyond Gaussian Data NIPS 2023
Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning ICML 2023
Spectral Evolution and Invariance in Linear-width Neural Networks NIPS 2023
TiDAL: Learning Training Dynamics for Active Learning ICCV 2023
A Theoretical Analysis of the Learning Dynamics under Class Imbalance ICML 2023
Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer NIPS 2023
HiGrad: Uncertainty Quantification for Online Learning and Stochastic Approximation JMLR 2023
Enhance Robustness of Machine Learning with Improved Efficiency AAAI 2023
Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond ICML 2023
Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models NIPS 2023
Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NIPS 2023
Improved Convergence in High Probability of Clipped Gradient Methods with Heavy Tailed Noise NIPS 2023
Asynchronous Iterations in Optimization: New Sequence Results and Sharper Algorithmic Guarantees JMLR 2023
Recursive Quantile Estimation: Non-Asymptotic Confidence Bounds JMLR 2023
On Learning Rates and Schrödinger Operators JMLR 2023
spred: Solving L1 Penalty with SGD ICML 2023
Large deviations rates for stochastic gradient descent with strongly convex functions AISTATS 2023
Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Rényi's Entropy Perspective IJCAI 2023
Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD AAAI 2023
Opposite Online Learning via Sequentially Integrated Stochastic Gradient Descent Estimators AAAI 2023
Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023
Finding Generalization Measures by Contrasting Signal and Noise ICML 2023
Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy ICML 2023