conftrace_

adaptive learning rate

58 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) non-convex optimization (547) stochastic optimization (1060) regret bound (1926) learning rate (192) variance reduction (523) gradient descent (1144) adam optimizer (54) online learning (1777) convergence guarantee (169)

Papers

Decentralized Online Convex Optimization with Unknown Feedback Delays AAAI 2026
PALM: Pushing Adaptive Learning Rate Mechanisms for Continual Test-Time Adaptation AAAI 2025
SMMF: Square-Matricized Momentum Factorization for Memory-Efficient Optimization AAAI 2025
Optimizing Personalized Federated Learning Through Adaptive Layer-Wise Learning IJCAI 2025
Faster Double Adaptive Gradient Methods AAAI 2025
On the Power of Optimism in Constrained Online Convex Optimization IJCAI 2025
A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NIPS 2024
Stepping on the Edge: Curvature Aware Learning Rate Tuners NIPS 2024
The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms NIPS 2024
Adaptive Federated Minimax Optimization with Lower Complexities AISTATS 2024
AdaLomo: Low-memory Optimization with Adaptive Learning Rate ACL 2024
A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of $\Theta(T^{2/3})$ and its Application to Best-of-Both-Worlds NIPS 2024
Improved Powered Stochastic Optimization Algorithms for Large-Scale Machine Learning JMLR 2023
AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning AAAI 2023
A General Regret Bound of Preconditioned Gradient Method for DNN Training CVPR 2023
Adaptive SGD with Polyak stepsize and Line-search: Robust Convergence and Variance Reduction NIPS 2023
Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum ICML 2022
Meta-Learning for Online Update of Recommender Systems AAAI 2022
A Stochastic Bundle Method for Interpolation JMLR 2022
Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration JMLR 2022
MetaER-TTE: An Adaptive Meta-learning Model for En Route Travel Time Estimation IJCAI 2022
MetaSLRCL: A Self-Adaptive Learning Rate and Curriculum Learning Based Framework for Few-Shot Text Classification COLING 2022
Adaptive Accelerated (Extra-)Gradient Methods with Variance Reduction ICML 2022
AdaLoss: A Computationally-Efficient and Provably Convergent Adaptive Gradient Method AAAI 2022
SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients NIPS 2021