stochastic gradient descent

Robust Learning for Data Poisoning Attacks ICML 2021 Robustness and scalability under heavy tails, without strong convexity AISTATS 2021 SBO-RNN: Reformulating Recurrent Neural Networks via Stochastic Bilevel Optimization NeurIPS 2021 Scaling Properties of Deep Residual Networks ICML 2021 Selfish Sparse RNN Training ICML 2021 SGD for Structured Nonconvex Functions: Learning Rates, Minibatching and Interpolation AISTATS 2021 SGD Generalizes Better Than GD (And Regularization Doesn’t Help) COLT 2021 SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality COLT 2021 SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs NeurIPS 2021 SGD with low-dimensional gradients with applications to private and distributed learning UAI 2021 Shape Matters: Understanding the Implicit Bias of the Noise Covariance COLT 2021 Shuffled Model of Differential Privacy in Federated Learning AISTATS 2021 Simple induction of (deterministic) probabilistic finite-state automata for phonotactics by stochastic gradient descent ACL 2021 Simple Stochastic and Online Gradient Descent Algorithms for Pairwise Learning NeurIPS 2021 Spherical Motion Dynamics: Learning Dynamics of Normalized Neural Network using SGD and Weight Decay NeurIPS 2021 Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021 Stability and Differential Privacy of Stochastic Gradient Descent for Pairwise Learning with Non-Smooth Loss AISTATS 2021 Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021 Stability and Generalization of Stochastic Gradient Methods for Minimax Problems ICML 2021 STL-SGD: Speeding Up Local SGD with Stagewise Communication Period AAAI 2021 Stochastic Gradient Descent Meets Distribution Regression AISTATS 2021 Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence AISTATS 2021 Stochastic Sign Descent Methods: New Algorithms and Better Theory ICML 2021 STORM+: Fully Adaptive SGD with Recursive Momentum for Nonconvex Optimization NeurIPS 2021 Streaming Linear System Identification with Reverse Experience Replay NeurIPS 2021