← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

The Implicit Regularization of Stochastic Gradient Flow for Least Squares ICML 2020
Fast and Three-rious: Speeding Up Weak Supervision with Triplet Methods ICML 2020
On Convergence-Diagnostic based Step Sizes for Stochastic Gradient Descent ICML 2020
Closing the convergence gap of SGD without replacement ICML 2020
Linear Mode Connectivity and the Lottery Ticket Hypothesis ICML 2020
How Good is the Bayes Posterior in Deep Neural Networks Really? ICML 2020
AdaScale SGD: A User-Friendly Algorithm for Distributed Training ICML 2020
Obtaining Adjustable Regularization for Free via Iterate Averaging ICML 2020
On the Noisy Gradient Descent that Generalizes as SGD ICML 2020
Zeno++: Robust Fully Asynchronous SGD ICML 2020
Moniqua: Modulo Quantized Communication in Decentralized SGD ICML 2020
A Mean Field Analysis Of Deep ResNet And Beyond: Towards Provably Optimization Via Overparameterization From Depth ICML 2020
pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization IJCAI 2020
Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks IJCAI 2020
A De Novo Divide-and-Merge Paradigm for Acoustic Model Optimization in Automatic Speech Recognition IJCAI 2020
Gradient Perturbation is Underrated for Differentially Private Convex Optimization IJCAI 2020
Delay-Adaptive Distributed Stochastic Optimization AAAI 2020
Differentially Private Learning with Small Public Data AAAI 2020
Quantized Compressive Sampling of Stochastic Gradients for Efficient Communication in Distributed Deep Learning AAAI 2020
Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks CVPR 2020
Online Robust Regression via SGD on the l1 loss NIPS 2020
Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Model NIPS 2020
Stochasticity of Deterministic Gradient Descent: Large Learning Rate for Multiscale Objective Function NIPS 2020
Stochastic Gradient Descent in Correlated Settings: A Study on Gaussian Processes NIPS 2020
Stability of Stochastic Gradient Descent on Nonsmooth Convex Losses NIPS 2020