← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Generalization Bounds for Gradient Methods via Discrete and Continuous Prior NIPS 2022
Communication-Compressed Adaptive Gradient Method for Distributed Nonconvex Optimization AISTATS 2022
Momentum Aggregation for Private Non-convex ERM NIPS 2022
High-dimensional limit theorems for SGD: Effective dynamics and critical scaling NIPS 2022
Sampling Approximately Low-Rank Ising Models: MCMC meets Variational Methods COLT 2022
Adaptation of the Independent Metropolis-Hastings Sampler with Normalizing Flow Proposals AISTATS 2022
A general sample complexity analysis of vanilla policy gradient AISTATS 2022
Better SGD using Second-order Momentum NIPS 2022
Privacy of Noisy Stochastic Gradient Descent: More Iterations without More Privacy Loss NIPS 2022
Power-Law Escape Rate of SGD ICML 2022
Differentially Private Coordinate Descent for Composite Empirical Risk Minimization ICML 2022
Randomized Stochastic Gradient Descent Ascent AISTATS 2022
Differentially Private Learning Needs Hidden State (Or Much Faster Convergence) NIPS 2022
Communication-efficient Distributed Learning for Large Batch Optimization ICML 2022
Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology ICML 2022
On the generalization of learning algorithms that do not converge NIPS 2022
Stochastic Reweighted Gradient Descent ICML 2022
Faster Privacy Accounting via Evolving Discretization ICML 2022
Heavy-tailed Streaming Statistical Estimation AISTATS 2022
Generalization Bounds for Stochastic Gradient Descent via Localized $\varepsilon$-Covers NIPS 2022
Improved Differential Privacy for SGD via Optimal Private Linear Operators on Adaptive Streams NIPS 2022
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NIPS 2022
Accelerated SGD for Non-Strongly-Convex Least Squares COLT 2022
On Almost Sure Convergence Rates of Stochastic Gradient Methods COLT 2022
Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022