adaptive optimization

Clipping the Price of Adaptivity at the Tail COLT 2026 FedAdamom: Adaptive Momentum for Improved Generalization in Federated Optimization CVPR 2026 Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks JMLR 2026 TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization AAAI 2026 Accelerating neural network training: An analysis of the AlgoPerf competition ICLR 2025 AdaFisher: Adaptive Second Order Optimization via Fisher Information ICLR 2025 Adaptive Methods through the Lens of SDEs: Theoretical Insights on the Role of Noise ICLR 2025 Convergence of Distributed Adaptive Optimization with Local Updates ICLR 2025 Efficient Distributed Optimization under Heavy-Tailed Noise ICML 2025 LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics ICLR 2025 Structured Preconditioners in Adaptive Optimization: A Unified Analysis ICML 2025 Adam with model exponential moving average is effective for nonconvex optimization NeurIPS 2024 MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence NeurIPS 2024 Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation NeurIPS 2024 Parameter-Agnostic Optimization under Relaxed Smoothness AISTATS 2024 Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact Subproblem Solver for Training Structured Neural Network NeurIPS 2024 AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023 Adaptive Constraint Partition Based Optimization Framework for Large-Scale Integer Linear Programming (Student Abstract) AAAI 2023 AstroNet: When Astrocyte Meets Artificial Neural Network CVPR 2023 Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers ICML 2023 CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023 Differentially Private Adaptive Optimization with Delayed Preconditioners ICLR 2023 DP-HyPO: An Adaptive Private Framework for Hyperparameter Optimization NeurIPS 2023 Faster Adaptive Federated Learning AAAI 2023 Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization EMNLP 2023