← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

AdaGrad Stepsizes: Sharp Convergence Over Nonconvex Landscapes ICML 2019
Universal Adversarial Perturbation via Prior Driven Uncertainty Approximation ICCV 2019
Small Steps and Giant Leaps: Minimal Newton Solvers for Deep Learning ICCV 2019
On the Computation and Communication Complexity of Parallel SGD with Dynamic Batch Sizes for Stochastic Non-Convex Optimization ICML 2019
On the Convergence of (Stochastic) Gradient Descent with Extrapolation for Non-Convex Minimization IJCAI 2019
Stochastic Nonconvex Optimization with Large Minibatches ALT 2019
Surrogate Losses for Online Learning of Stepsizes in Stochastic Non-Convex Optimization ICML 2019
Computationally and Statistically Efficient Truncated Regression COLT 2019
Tight analyses for non-smooth stochastic gradient descent COLT 2019
Making the Last Iterate of SGD Information Theoretically Optimal COLT 2019
Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit COLT 2019
Two Tiered Distributed Training Algorithm for Acoustic Modeling INTERSPEECH 2019
Submodular Batch Selection for Training Deep Neural Networks IJCAI 2019
Trading Redundancy for Communication: Speeding up Distributed SGD for Non-convex Optimization ICML 2019
Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training IJCNLP 2019
Stochastic Gradient Descent Learns State Equations with Nonlinear Activations COLT 2019
Open Problem: Do Good Algorithms Necessarily Query Bad Points? COLT 2019
Learning Ising Models with Independent Failures COLT 2019
Sharp Analysis for Nonconvex SGD Escaping from Saddle Points COLT 2019
Normal Approximation for Stochastic Gradient Descent via Non-Asymptotic Rates of Martingale CLT COLT 2019
On the Convergence of Stochastic Gradient Descent with Adaptive Stepsizes AISTATS 2019
A Stochastic Composite Gradient Method with Incremental Variance Reduction NIPS 2019
Data Cleansing for Models Trained with SGD NIPS 2019
Understanding the Role of Momentum in Stochastic Gradient Methods NIPS 2019
Communication trade-offs for Local-SGD with large step size NIPS 2019