stochastic gradient descent

Implicit Stochastic Gradient Descent for Training Physics-Informed Neural Networks AAAI 2023 Improved Convergence in High Probability of Clipped Gradient Methods with Heavy Tailed Noise NeurIPS 2023 Improved Convergence of Differential Private SGD with Gradient Clipping ICLR 2023 Improved Powered Stochastic Optimization Algorithms for Large-Scale Machine Learning JMLR 2023 Improving the Privacy and Practicality of Objective Perturbation for Differentially Private Linear Learners NeurIPS 2023 Inconsistency, Instability, and Generalization Gap of Deep Neural Network Training NeurIPS 2023 Integrating Random Effects in Deep Neural Networks JMLR 2023 KAKURENBO: Adaptively Hiding Samples in Deep Neural Network Training NeurIPS 2023 Label Robust and Differentially Private Linear Regression: Computational and Statistical Efficiency NeurIPS 2023 Large deviations rates for stochastic gradient descent with strongly convex functions AISTATS 2023 Learning Compact Features via In-Training Representation Alignment AAAI 2023 Learning Exponential Families from Truncated Samples NeurIPS 2023 Learning-Rate-Free Learning by D-Adaptation ICML 2023 Learning Trajectories are Generalization Indicators NeurIPS 2023 Mixtures of All Trees AISTATS 2023 Momentum Ensures Convergence of SIGNSGD under Weaker Assumptions ICML 2023 Multi-Epoch Matrix Factorization Mechanisms for Private Machine Learning ICML 2023 Naive imputation implicitly regularizes high-dimensional linear models ICML 2023 Nesterov Meets Optimism: Rate-Optimal Separable Minimax Optimization ICML 2023 Network Effects in Performative Prediction Games ICML 2023 Neural Networks Efficiently Learn Low-Dimensional Representations with SGD ICLR 2023 Neural networks trained with SGD learn distributions of increasing complexity ICML 2023 Noise Is Not the Main Factor Behind the Gap Between Sgd and Adam on Transformers, But Sign Descent Might Be ICLR 2023 Nonconvex stochastic scaled gradient descent and generalized eigenvector problems UAI 2023 Non-reversible Parallel Tempering for Deep Posterior Approximation AAAI 2023