← Keywords

stochastic gradient descent

1088 papers

Explore in graph

Also known as

SGD ASGD SAGA SGM SGDA PSGD SKGD

Co-occurring keywords

non-convex optimization (546) distributed learning (563) neural network optimization (1293) convergence rate (606) convex optimization (1320) neural network (6616) variance reduction (520) stochastic optimization (1060) convergence analysis (394) differential privacy (1010)

Papers

Smoothing the Landscape Boosts the Signal for SGD: Optimal Sample Complexity for Learning Single Index Models NIPS 2023
Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning ICML 2023
Stability and Generalization of the Decentralized Stochastic Gradient Descent Ascent Algorithm NIPS 2023
Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent NIPS 2023
Learning Exponential Families from Truncated Samples NIPS 2023
Integrating Random Effects in Deep Neural Networks JMLR 2023
Robust Collaborative Learning with Linear Gradient Overhead ICML 2023
Distributed Stochastic Nested Optimization for Emerging Machine Learning Models: Algorithm and Theory AAAI 2023
Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning ICML 2023
Enhance Robustness of Machine Learning with Improved Efficiency AAAI 2023
Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Rényi's Entropy Perspective IJCAI 2023
Learning Trajectories are Generalization Indicators NIPS 2023
On the Stability and Generalization of Triplet Learning AAAI 2023
Implicit Bias of (Stochastic) Gradient Descent for Rank-1 Linear Neural Network NIPS 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods NIPS 2023
Opposite Online Learning via Sequentially Integrated Stochastic Gradient Descent Estimators AAAI 2023
On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms NIPS 2023
A Unified Fast Gradient Clipping Framework for DP-SGD NIPS 2023
Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width NIPS 2023
Efficient Privacy-Preserving Stochastic Nonconvex Optimization UAI 2023
Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond ICML 2023
Special Properties of Gradient Descent with Large Learning Rates ICML 2023
Finding Generalization Measures by Contrasting Signal and Noise ICML 2023
Stability-Based Generalization Analysis for Mixtures of Pointwise and Pairwise Learning AAAI 2023
Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent NIPS 2023