adaptive learning rate

Adaptive Learning Rates with Surrogate Probability for Follow-the-Perturbed-Leader COLT 2026 Decentralized Online Convex Optimization with Unknown Feedback Delays AAAI 2026 ADAM Optimization with Adaptive Batch Selection ICLR 2025 Faster Double Adaptive Gradient Methods AAAI 2025 Layer-wise Quantization for Quantized Optimistic Dual Averaging ICML 2025 Online Learning with Stochastically Partitioning Experts UAI 2025 On the Convergence of Continual Federated Learning Using Incrementally Aggregated Gradients AISTATS 2025 On the Power of Optimism in Constrained Online Convex Optimization IJCAI 2025 Optimizing Personalized Federated Learning Through Adaptive Layer-Wise Learning IJCAI 2025 PALM: Pushing Adaptive Learning Rate Mechanisms for Continual Test-Time Adaptation AAAI 2025 SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization AAAI 2025 AdaLomo: Low-memory Optimization with Adaptive Learning Rate ACL 2024 Adaptive Federated Minimax Optimization with Lower Complexities AISTATS 2024 Adaptive Learning Rate for Follow-the-Regularized-Leader: Competitive Analysis and Best-of-Both-Worlds COLT 2024 A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NeurIPS 2024 A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of Θ(T^2/3) and its Application to Best-of-Both-Worlds NeurIPS 2024 Dynamic Byzantine-Robust Learning: Adapting to Switching Byzantine Workers ICML 2024 MoMo: Momentum Models for Adaptive Learning Rates ICML 2024 Stepping on the Edge: Curvature Aware Learning Rate Tuners NeurIPS 2024 The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms NeurIPS 2024 Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction NeurIPS 2023 AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning AAAI 2023 A General Regret Bound of Preconditioned Gradient Method for DNN Training CVPR 2023 Improved Powered Stochastic Optimization Algorithms for Large-Scale Machine Learning JMLR 2023 Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport ICLR 2023