conftrace_

adaptive gradient descent

4 papers

Explore in graph

Also known as

ADAGRAD

Co-occurring keywords

convergence rate (607) convergence analysis (395) stochastic gradient descent (1091) stochastic optimization (1060) momentum technique (1) gradient complexity (26) filter level sparsity (1) neural network speedup (1) implicit sparsity (1) filter sparsity (1)

Papers

On Convergence of Adam for Stochastic Optimization under Relaxed Assumptions NIPS 2024
AdaGDA: Faster Adaptive Gradient Descent Ascent Methods for Minimax Optimization AISTATS 2023
AdaGrad stepsizes: Sharp convergence over nonconvex landscapes JMLR 2020
On Implicit Filter Level Sparsity in Convolutional Neural Networks CVPR 2019