conftrace_

adaptive optimization

52 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) adam optimizer (54) neural network optimization (1293) stochastic optimization (1060) convergence rate (607) learning rate (192) gradient descent (1144) federated learning (1333) adaptive algorithm (114) neural network training (309)

Papers

TRACE: A Generalizable Drift Detector for Streaming Data-Driven Optimization AAAI 2026
Parameter-Agnostic Optimization under Relaxed Smoothness AISTATS 2024
MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence NIPS 2024
Adam with model exponential moving average is effective for nonconvex optimization NIPS 2024
Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation NIPS 2024
Regularized Adaptive Momentum Dual Averaging with an Efficient Inexact Subproblem Solver for Training Structured Neural Network NIPS 2024
CAME: Confidence-guided Adaptive Memory Efficient Optimization ACL 2023
AdaNorm: Adaptive Gradient Norm Correction Based Optimizer for CNNs WACV 2023
Flash: Concept Drift Adaptation in Federated Learning ICML 2023
Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers ICML 2023
Adaptive Constraint Partition Based Optimization Framework for Large-Scale Integer Linear Programming (Student Abstract) AAAI 2023
AstroNet: When Astrocyte Meets Artificial Neural Network CVPR 2023
How Does Adaptive Optimization Impact Local Neural Network Geometry? NIPS 2023
Winning the CityLearn Challenge: Adaptive Optimization with Evolutionary Search under Trajectory-Based Guidance AAAI 2023
Faster Adaptive Federated Learning AAAI 2023
SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance ICML 2023
DP-HyPO: An Adaptive Private Framework for Hyperparameter Optimization NIPS 2023
Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization EMNLP 2023
Communication-Efficient Adaptive Federated Learning ICML 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization ICML 2022
A consistently adaptive trust-region method NIPS 2022
Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training JMLR 2022
Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022
Private Adaptive Optimization with Side information ICML 2022
Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NIPS 2022