adaptive optimization

Flash: Concept Drift Adaptation in Federated Learning ICML 2023 How Does Adaptive Optimization Impact Local Neural Network Geometry? NeurIPS 2023 SGD with AdaGrad Stepsizes: Full Adaptivity with High Probability to Unknown Parameters, Unbounded Gradients and Affine Variance ICML 2023 Unified Detoxifying and Debiasing in Language Generation via Inference-time Adaptive Optimization ICLR 2023 Winning the CityLearn Challenge: Adaptive Optimization with Evolutionary Search under Trajectory-Based Guidance AAAI 2023 Accelerated Federated Learning with Decoupled Adaptive Optimization ICML 2022 A consistently adaptive trust-region method NeurIPS 2022 Communication-Efficient Adaptive Federated Learning ICML 2022 Doubly Adaptive Scaled Algorithm for Machine Learning Using Second-Order Information ICLR 2022 Dynamics of SGD with Stochastic Polyak Stepsizes: Truly Adaptive Variants and Convergence to Exact Solution NeurIPS 2022 KOALA: A Kalman Optimization Algorithm with Loss Adaptivity AAAI 2022 Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training JMLR 2022 On Distributed Adaptive Optimization with Gradient Compression ICLR 2022 Private Adaptive Optimization with Side information ICML 2022 Towards Noise-adaptive, Problem-adaptive (Accelerated) Stochastic Gradient Descent ICML 2022 1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021 Adaptive Denoising via GainTuning NeurIPS 2021 Adaptive Federated Optimization ICLR 2021 Adaptive Proximal Gradient Methods for Structured Neural Networks NeurIPS 2021 A first-order primal-dual method with adaptivity to local smoothness NeurIPS 2021 CADA: Communication-Adaptive Distributed Adam AISTATS 2021 Domain-Independent Dominance of Adaptive Methods CVPR 2021 MTAdam: Automatic Balancing of Multiple Training Loss Terms EMNLP 2021 On the Adequacy of Untuned Warmup for Adaptive Optimization AAAI 2021 Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning OSDI 2021