← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Convergence rates and approximation results for SGD and its continuous-time counterpart COLT 2021
Regularizing Neural Networks via Adversarial Model Perturbation CVPR 2021
Automatic variational inference with cascading flows ICML 2021
THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021
Continuized Accelerations of Deterministic and Stochastic Gradient Descents, and of Gossip Algorithms NIPS 2021
Label Noise SGD Provably Prefers Flat Global Minimizers NIPS 2021
Generalized Linear Bandits with Local Differential Privacy NIPS 2021
STORM+: Fully Adaptive SGD with Recursive Momentum for Nonconvex Optimization NIPS 2021
An Efficient Algorithm for Deep Stochastic Contextual Bandits AAAI 2021
SGD Generalizes Better Than GD (And Regularization Doesn’t Help) COLT 2021
Toward Better Generalization Bounds with Locally Elastic Stability ICML 2021
Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization ICML 2021
Efficient Truncated Linear Regression with Unknown Noise Variance NIPS 2021
Optimal Rates for Random Order Online Optimization NIPS 2021
The Benefits of Implicit Regularization from SGD in Least Squares Problems NIPS 2021
When All We Need is a Piece of the Pie: A Generic Framework for Optimizing Two-way Partial AUC ICML 2021
Exponential Convergence Rates of Classification Errors on Learning with SGD and Random Features AISTATS 2021
vqSGD: Vector Quantized Stochastic Gradient Descent AISTATS 2021
(Nearly) Dimension Independent Private ERM with AdaGrad Rates\{via Publicly Estimated Subspaces COLT 2021
CADA: Communication-Adaptive Distributed Adam AISTATS 2021
Robustness and scalability under heavy tails, without strong convexity AISTATS 2021
Differentially Private and Communication Efficient Collaborative Learning AAAI 2021
Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance NIPS 2021
Elastic Consistency: A Practical Consistency Model for Distributed Stochastic Gradient Descent AAAI 2021
Is SGD a Bayesian sampler? Well, almost JMLR 2021