momentum method

Boosting Medical Vision-Language Pretraining via Momentum Self-Distillation under Limited Computing Resources WACV 2026 Vanilla SGD with Momentum Survives Heavy-Tailed Noise: Convergence Analysis without Gradient Clipping or Normalization UAI 2026 Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization ICLR 2025 Accelerating optimization over the space of probability measures JMLR 2025 Decentralized Projected Riemannian Stochastic Recursive Momentum Method for Nonconvex Optimization AAAI 2025 Do Stochastic, Feel Noiseless: Stable Stochastic Optimization via a Double Momentum Mechanism ICLR 2025 Effects of Momentum in Implicit Bias of Gradient Flow for Diagonal Linear Networks AAAI 2025 Gradient correlation is a key ingredient to accelerate SGD with momentum ICLR 2025 Last-iterate Convergence of Shuffling Momentum Gradient Method under the Kurdyka-Lojasiewicz Inequality JMLR 2025 Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning JMLR 2025 On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm JMLR 2025 On the Performance Analysis of Momentum Method: A Frequency Domain Perspective ICLR 2025 SGD with memory: fundamental properties and stochastic acceleration ICLR 2025 STIMULUS: Achieving Fast Convergence and Low Sample Complexity in Stochastic Multi-Objective Learning UAI 2025 Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance ICLR 2025 Accelerated Regularized Learning in Finite N-Person Games NeurIPS 2024 Adam with model exponential moving average is effective for nonconvex optimization NeurIPS 2024 ADOPT: Modified Adam Can Converge with Any β_2 with the Optimal Rate NeurIPS 2024 Diffusion Sampling with Momentum for Mitigating Divergence Artifacts ICLR 2024 Efficient Asynchronous Federated Learning with Prospective Momentum Aggregation and Fine-Grained Correction AAAI 2024 Lion Secretly Solves a Constrained Optimization: As Lyapunov Predicts ICLR 2024 On PI Controllers for Updating Lagrange Multipliers in Constrained Optimization ICML 2024 On the Convergence of an Adaptive Momentum Method for Adversarial Attacks AAAI 2024 On the Generalization of Stochastic Gradient Descent with Momentum JMLR 2024 Parameter-Agnostic Optimization under Relaxed Smoothness AISTATS 2024