← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Generalization Guarantee of SGD for Pairwise Learning NIPS 2021
Gradient Methods Never Overfit On Separable Data JMLR 2021
Simple Stochastic and Online Gradient Descent Algorithms for Pairwise Learning NIPS 2021
Random Shuffling Beats SGD Only After Many Epochs on Ill-Conditioned Problems NIPS 2021
Escaping Saddle Points with Compressed SGD NIPS 2021
Asynchronous Decentralized SGD with Quantized and Local Updates NIPS 2021
An Analysis of Constant Step Size SGD in the Non-convex Regime: Asymptotic Normality and Bias NIPS 2021
Dynamics of Stochastic Momentum Methods on Large-scale, Quadratic Models NIPS 2021
The Benefits of Implicit Regularization from SGD in Least Squares Problems NIPS 2021
AC-GC: Lossy Activation Compression with Guaranteed Convergence NIPS 2021
Optimal Rates for Random Order Online Optimization NIPS 2021
Efficient Truncated Linear Regression with Unknown Noise Variance NIPS 2021
Closing the Gap: Tighter Analysis of Alternating Stochastic Gradient Methods for Bilevel Problems NIPS 2021
Streaming Linear System Identification with Reverse Experience Replay NIPS 2021
Differentially Private and Communication Efficient Collaborative Learning AAAI 2021
CWY Parametrization: a Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices AISTATS 2021
Convergence rates and approximation results for SGD and its continuous-time counterpart COLT 2021
ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization AAAI 2021
Regularizing Neural Networks via Adversarial Model Perturbation CVPR 2021
Simple induction of (deterministic) probabilistic finite-state automata for phonotactics by stochastic gradient descent ACL 2021
Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices NIPS 2021
Asynchronous Stochastic Gradient Descent for Extreme-Scale Recommender Systems AAAI 2021
Explicit Regularization of Stochastic Gradient Methods through Duality AISTATS 2021
Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates AISTATS 2021