conftrace_

adaptive optimization

52 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) adam optimizer (54) neural network optimization (1293) stochastic optimization (1060) convergence rate (607) learning rate (192) gradient descent (1144) federated learning (1333) adaptive algorithm (114) neural network training (309)

Papers

A consistently adaptive trust-region method NIPS 2022
CADA: Communication-Adaptive Distributed Adam AISTATS 2021
Adaptive Denoising via GainTuning NIPS 2021
MTAdam: Automatic Balancing of Multiple Training Loss Terms EMNLP 2021
Domain-Independent Dominance of Adaptive Methods CVPR 2021
On the Adequacy of Untuned Warmup for Adaptive Optimization AAAI 2021
The Implicit Bias for Adaptive Optimization Algorithms on Homogeneous Neural Networks ICML 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam’s Convergence Speed ICML 2021
A first-order primal-dual method with adaptivity to local smoothness NIPS 2021
Adaptive Proximal Gradient Methods for Structured Neural Networks NIPS 2021
Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning OSDI 2021
A General System of Differential Equations to Model First-Order Adaptive Algorithms JMLR 2020
AdaTune: Adaptive Tensor Program Compilation Made Efficient NIPS 2020
Using Statistics to Automate Stochastic Optimization NIPS 2019
HyperAdam: A Learnable Task-Adaptive Adam for Network Training AAAI 2019
Memory Efficient Adaptive Optimization NIPS 2019
Local Saddle Point Optimization: A Curvature Exploitation Approach AISTATS 2019
Coordinate Descent with Bandit Sampling NIPS 2018
Bandit Online Learning on Graphs via Adaptive Optimization IJCAI 2018
LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning NIPS 2018
Adaptive Relaxed ADMM: Convergence Theory and Practical Implementation CVPR 2017
Follow the Moving Leader in Deep Learning ICML 2017
A Modular Analysis of Adaptive (Non-)Convex Optimization: Optimism, Composite Objectives, and Variational Bounds ALT 2017
Adaptive Maximization of Pointwise Submodular Functions With Budget Constraint NIPS 2016
Adaptive Stochastic Optimization: From Sets to Paths NIPS 2015