stochastic gradient descent

Benign Oscillation of Stochastic Gradient Descent with Large Learning Rate ICLR 2024 BFCI at AraFinNLP2024: Support Vector Machines for Arabic Financial Text Classification ACL 2024 Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training NeurIPS 2024 Bias of Stochastic Gradient Descent or the Architecture: Disentangling the Effects of Overparameterization of Neural Networks ICML 2024 Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression ICLR 2024 Certified Machine Unlearning via Noisy Stochastic Gradient Descent NeurIPS 2024 Communication Efficient Distributed Training with Distributed Lion NeurIPS 2024 Continual learning with the neural tangent ensemble NeurIPS 2024 Convergence of Bayesian Bilevel Optimization ICLR 2024 CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference NeurIPS 2024 Decentralized Sum-of-Nonconvex Optimization AAAI 2024 Derivatives of Stochastic Gradient Descent in parametric optimization NeurIPS 2024 Diagonalisation SGD: Fast & Convergent SGD for Non-Differentiable Models via Reparameterisation and Smoothing AISTATS 2024 Differentially Private SGD Without Clipping Bias: An Error-Feedback Approach ICLR 2024 Differentially Private Stochastic Gradient Descent with Fixed-Size Minibatches: Tighter RDP Guarantees with or without Replacement NeurIPS 2024 Distributionally Robust Optimization with Bias and Variance Reduction ICLR 2024 Does Worst-Performing Agent Lead the Pack? Analyzing Agent Dynamics in Unified Distributed SGD NeurIPS 2024 Don't Compress Gradients in Random Reshuffling: Compress Gradient Differences NeurIPS 2024 DOPPLER: Differentially Private Optimizers with Low-pass Filter for Privacy Noise Reduction NeurIPS 2024 Efficient Online Set-valued Classification with Bandit Feedback ICML 2024 Emergence of heavy tails in homogenized stochastic gradient descent NeurIPS 2024 Error Feedback Reloaded: From Quadratic to Arithmetic Mean of Smoothness Constants ICLR 2024 Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression AISTATS 2024 Estimating Generalization Performance Along the Trajectory of Proximal SGD in Robust Regression NeurIPS 2024 Exact Mean Square Linear Stability Analysis for SGD COLT 2024