adaptive gradient method

Fast and Large-Scale Unbalanced Optimal Transport via its Semi-Dual and Adaptive Gradient Methods COLT 2026 AdaR: An Adaptive Gradient Method with Cyclical Restarting of Moment Estimations IJCAI 2025 Faster Double Adaptive Gradient Methods AAAI 2025 On the O(sqrt(d)/T^(1/4)) Convergence Rate of RMSProp and Its Momentum Extension Measured by l_1 Norm JMLR 2025 Adaptive Proximal Gradient Method for Convex Optimization NeurIPS 2024 ADOPT: Modified Adam Can Converge with Any β_2 with the Optimal Rate NeurIPS 2024 Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective ICML 2024 FedDA: Faster Adaptive Gradient Methods for Federated Constrained Optimization ICLR 2024 Iterate Averaging in the Quest for Best Test Error JMLR 2024 Open Problem: Black-Box Reductions and Adaptive Gradient Methods for Nonconvex Optimization COLT 2024 Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad NeurIPS 2024 Revisiting Convergence of AdaGrad with Relaxed Assumptions UAI 2024 Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction NeurIPS 2024 CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023 Fed-LAMB: Layer-wise and Dimension-wise Locally Adaptive Federated Learning UAI 2023 On the Convergence of AdaGrad(Norm) on R^d: Beyond Convexity, Non-Asymptotic Rate and Acceleration ICLR 2023 AdaBlock: SGD with Practical Block Diagonal Matrix Adaptation for Deep Learning AISTATS 2022 A Momentumized, Adaptive, Dual Averaged Gradient Method JMLR 2022 High Probability Bounds for a Class of Nonconvex Algorithms with AdaGrad Stepsize ICLR 2022 On the Convergence of Decentralized Adaptive Gradient Methods ACML 2022 On the SDEs and Scaling Rules for Adaptive Gradient Algorithms NeurIPS 2022 Robust Training of Neural Networks Using Scale Invariant Architectures ICML 2022 The Power of Adaptivity in SGD: Self-Tuning Step Sizes with Unbounded Gradients and Affine Variance COLT 2022 ACMo: Angle-Calibrated Moment Methods for Stochastic Optimization AAAI 2021 Adaptive Gradient Methods for Constrained Convex Optimization and Variational Inequalities AAAI 2021