Stochastic Methods

Stochastic Gradient Methods: Bias, Stability and Generalization JMLR 2026 The Convergence Behavior of Adam under Heavy-Tailed Noise UAI 2026 Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization COLT 2026 Universality of high-dimensional scaling limits of stochastic gradient descent (extended abstract) COLT 2026 Vanilla SGD with Momentum Survives Heavy-Tailed Noise: Convergence Analysis without Gradient Clipping or Normalization UAI 2026 Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method ALT 2026 Variance Reduction for Non-Log-Concave Sampling with Applications to Inverse Problems UAI 2026 Vector-valued self-normalized concentration inequalities beyond sub-Gaussianity ALT 2026 3D Test-time Adaptation via Graph Spectral Driven Point Shift ICCV 2025 Accelerating Diffusion Sampling via Exploiting Local Transition Coherence ICCV 2025 AdaGK-SGD: Adaptive Global Knowledge Guided Distributed Stochastic Gradient Descent AAAI 2025 Adaptive Batch Size for Privately Finding Second-Order Stationary Points ICLR 2025 Adaptive Client Sampling in Federated Learning via Online Learning with Bandit Feedback JMLR 2025 Adaptive Non-Uniform Timestep Sampling for Accelerating Diffusion Model Training CVPR 2025 Analyzing and Modeling LLM Response Lengths with Extreme Value Theory: Anchoring Effects and Hybrid Distributions EMNLP 2025 A Stochastic Approach to Bi-Level Optimization for Hyperparameter Optimization and Meta Learning AAAI 2025 Batch Ensemble for Variance Dependent Regret in Stochastic Bandits AAAI 2025 Boosting Test Performance with Importance Sampling--a Subpopulation Perspective AAAI 2025 Cautious Next Token Prediction ACL 2025 Computing Quasi-Nash Equilibria via Gradient-Response Schemes L4DC 2025 Contextual Stochastic Optimization for School Desegregation Policymaking AAAI 2025 Convergence Rate in a Nonlinear Two-Time-Scale Stochastic Approximation with State (Time)-Dependence AAAI 2025 Coupling-based Convergence Diagnostic and Stepsize Scheme for Stochastic Gradient Descent AAAI 2025 Cross-Validated Off-Policy Evaluation AAAI 2025 Descent with Misaligned Gradients and Applications to Hidden Convexity ICLR 2025