← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Differentially Private Learning Needs Hidden State (Or Much Faster Convergence) NIPS 2022
Toward Physically Realizable Quantum Neural Networks AAAI 2022
Stochastic Variance Reduced Ensemble Adversarial Attack for Boosting the Adversarial Transferability CVPR 2022
Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$-Covers NIPS 2022
Masked Training of Neural Networks with Partial Gradients AISTATS 2022
Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions With Superior OOD Generalization CVPR 2022
Better SGD using Second-order Momentum NIPS 2022
Riemannian Stochastic Proximal Gradient Methods for Nonsmooth Optimization over the Stiefel Manifold JMLR 2022
High Probability Guarantees for Nonconvex Stochastic Gradient Descent with Heavy Tails ICML 2022
Understanding the unstable convergence of gradient descent ICML 2022
ROOT-SGD: Sharp Nonasymptotics and Asymptotic Efficiency in a Single Algorithm COLT 2022
Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams NIPS 2022
Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization JMLR 2022
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks JMLR 2022
Multirate Training of Neural Networks ICML 2022
Data sampling affects the complexity of online SGD over dependent data UAI 2022
On Biased Stochastic Gradient Estimation JMLR 2022
Learning-based Moving Horizon Estimation through Differentiable Convex Optimization Layers L4DC 2022
Sample Average Approximation for Stochastic Optimization with Dependent Data: Performance Guarantees and Tractability AAAI 2022
Communication-Compressed Adaptive Gradient Method for Distributed Nonconvex Optimization AISTATS 2022
Shifted compression framework: generalizations and improvements UAI 2022
Better Parameter-Free Stochastic Optimization with ODE Updates for Coin-Betting AAAI 2022
Adaptation of the Independent Metropolis-Hastings Sampler with Normalizing Flow Proposals AISTATS 2022
A general sample complexity analysis of vanilla policy gradient AISTATS 2022
Power-Law Escape Rate of SGD ICML 2022