conftrace_

adaptive method

30 papers

Explore in graph

Co-occurring keywords

stochastic optimization (1060) stochastic gradient descent (1091) convex optimization (1321) convergence rate (607) convergence guarantee (169) regret bound (1926) learning rate (192) neural network optimization (1293) online learning (1777) exp-concave function (6)

Papers

AdaO2B: Adaptive Online to Batch Conversion for Out-of-Distribution Generalization AAAI 2025
MorphMark: Flexible Adaptive Watermarking for Large Language Models ACL 2025
On Adaptive Stochastic Optimization for Streaming Data: A Newton's Method with O(dN) Operations JMLR 2025
Adaptive and Optimal Second-order Optimistic Methods for Minimax Optimization NIPS 2024
Scaled Conjugate Gradient Method for Nonconvex Optimization in Deep Neural Networks JMLR 2024
On the convergence of adaptive first order methods: Proximal gradient and alternating minimization algorithms L4DC 2024
Block Low-Rank Preconditioner with Shared Basis for Stochastic Optimization NIPS 2023
On the Convergence of Continual Learning with Adaptive Methods UAI 2023
Two Sides of One Coin: the Limits of Untuned SGD and the Power of Adaptive Methods NIPS 2023
Momentum Accelerates the Convergence of Stochastic AUPRC Maximization AISTATS 2022
A consistently adaptive trust-region method NIPS 2022
Understanding Stochastic Optimization Behavior at the Layer Update Level (Student Abstract) AAAI 2022
On Elimination Strategies for Bandit Fixed-Confidence Identification NIPS 2022
MetaGrad: Adaptation using Multiple Learning Rates in Online Learning JMLR 2021
Adaptive First-Order Methods Revisited: Convex Minimization without Lipschitz Requirements NIPS 2021
ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning AAAI 2021
Private Adaptive Gradient Methods for Convex Optimization ICML 2021
Spatial Resolution of Early Reflection for Speech and White Noise INTERSPEECH 2020
Why are Adaptive Methods Good for Attention Models? NIPS 2020
Convergence Guarantees for Adaptive Bayesian Quadrature Methods NIPS 2019
The Role of Memory in Stochastic Optimization UAI 2019
Adaptive Negative Curvature Descent with Applications in Non-convex Optimization NIPS 2018
Online Adaptive Methods, Universality and Acceleration NIPS 2018
Coordinate Descent with Bandit Sampling NIPS 2018
The Marginal Value of Adaptive Gradient Methods in Machine Learning NIPS 2017