stochastic gradient descent

A Variational Perspective on High-Resolution ODEs NeurIPS 2023 A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta. ICLR 2023 Backward Feature Correction: How Deep Learning Performs Deep (Hierarchical) Learning COLT 2023 Benign Overfitting of Constant-Stepsize SGD for Linear Regression JMLR 2023 Beyond Lipschitz Smoothness: A Tighter Analysis for Nonconvex Optimization ICML 2023 Beyond Uniform Lipschitz Condition in Differentially Private Optimization ICML 2023 Communication-Efficient Stochastic Gradient Descent Ascent with Momentum Algorithms IJCAI 2023 Convergence of First-Order Methods for Constrained Nonconvex Optimization with Dependent Data ICML 2023 Convergence of mean-field Langevin dynamics: time-space discretization, stochastic gradient, and variance reduction NeurIPS 2023 Coordinating Distributed Example Orders for Provably Accelerated Training NeurIPS 2023 D4FT: A Deep Learning Approach to Kohn-Sham Density Functional Theory ICLR 2023 Data Banzhaf: A Robust Data Valuation Framework for Machine Learning AISTATS 2023 Data-driven Optimal Filtering for Linear Systems with Unknown Noise Covariances NeurIPS 2023 Decentralized Learning: Theoretical Optimality and Practical Improvements JMLR 2023 Decentralized Riemannian Algorithm for Nonconvex Minimax Problems AAAI 2023 Differentially Private Adaptive Optimization with Delayed Preconditioners ICLR 2023 Differentially Private Algorithms for the Stochastic Saddle Point Problem with Optimal Rates for the Strong Gap COLT 2023 Differentially Private Image Classification by Learning Priors from Random Processes NeurIPS 2023 Disentangling the Mechanisms Behind Implicit Regularization in SGD ICLR 2023 Dissecting the Effects of SGD Noise in Distinct Regimes of Deep Learning ICML 2023 Distributed Stochastic Nested Optimization for Emerging Machine Learning Models: Algorithm and Theory AAAI 2023 Does Momentum Help in Stochastic Optimization? A Sample Complexity Analysis. UAI 2023 DoG is SGD’s Best Friend: A Parameter-Free Dynamic Step Size Schedule ICML 2023 Don't be so Monotone: Relaxing Stochastic Line Search in Over-Parameterized Models NeurIPS 2023 DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training ICLR 2023