conftrace_

momentum method

75 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) convergence rate (607) gradient descent (1144) stochastic optimization (1060) non-convex optimization (547) nonconvex optimization (316) convergence analysis (395) variance reduction (523) convex optimization (1321) nesterov acceleration (54)

Papers

Boosting Medical Vision-Language Pretraining via Momentum Self-Distillation under Limited Computing Resources WACV 2026
Decentralized Projected Riemannian Stochastic Recursive Momentum Method for Nonconvex Optimization AAAI 2025
Accelerating optimization over the space of probability measures JMLR 2025
Effects of Momentum in Implicit Bias of Gradient Flow for Diagonal Linear Networks AAAI 2025
On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm JMLR 2025
Last-iterate Convergence of Shuffling Momentum Gradient Method under the Kurdyka-Lojasiewicz Inequality JMLR 2025
Nonconvex Stochastic Bregman Proximal Gradient Method with Application to Deep Learning JMLR 2025
Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions JMLR 2024
Parameter-Agnostic Optimization under Relaxed Smoothness AISTATS 2024
Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024
Adam with model exponential moving average is effective for nonconvex optimization NIPS 2024
Efficient Asynchronous Federated Learning with Prospective Momentum Aggregation and Fine-Grained Correction AAAI 2024
On the Convergence of an Adaptive Momentum Method for Adversarial Attacks AAAI 2024
On the Generalization of Stochastic Gradient Descent with Momentum JMLR 2024
ADOPT: Modified Adam Can Converge with Any $\beta_2$ with the Optimal Rate NIPS 2024
Accelerated Regularized Learning in Finite N-Person Games NIPS 2024
Unifying Nesterov’s Accelerated Gradient Methods for Convex and Strongly Convex Objective Functions ICML 2023
Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization AAAI 2023
Does Momentum Help in Stochastic Optimization? A Sample Complexity Analysis. UAI 2023
Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning ICML 2023
Catalyst Acceleration of Error Compensated Methods Leads to Better Communication Complexity AISTATS 2023
Generalized Polyak Step Size for First Order Optimization with Momentum ICML 2023
Communication-Efficient Stochastic Gradient Descent Ascent with Momentum Algorithms IJCAI 2023
Nesterov Accelerated Shuffling Gradient Method for Convex Optimization ICML 2022
Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-Lojasiewicz Functions when the Non-Convexity is Averaged-Out ICML 2022