conftrace_

convergence rate

607 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) convex optimization (1321) stochastic optimization (1060) gradient descent (1144) convergence analysis (395) non-convex optimization (547) nonconvex optimization (316) variance reduction (523) stochastic gradient (296) learning theory (519)

Papers

On the Convergence of Step Decay Step-Size for Stochastic Optimization NIPS 2021
Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance NIPS 2021
PID Accelerated Value Iteration Algorithm ICML 2021
First-Order Methods for Wasserstein Distributionally Robust MDP ICML 2021
A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks AISTATS 2021
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback NIPS 2021
Sifting through the noise: Universal first-order methods for stochastic variational inequalities NIPS 2021
An Improved Analysis and Rates for Variance Reduction under Without-replacement Sampling Orders NIPS 2021
Fast Learning for Renewal Optimization in Online Task Scheduling JMLR 2021
Universal consistency and rates of convergence of multiclass prototype algorithms in metric spaces JMLR 2021
Nonparametric Modeling of Higher-Order Interactions via Hypergraphons JMLR 2021
A Lyapunov Analysis of Accelerated Methods in Optimization JMLR 2021
A Unified Analysis of First-Order Methods for Smooth Games via Integral Quadratic Constraints JMLR 2021
Adaptive estimation of nonparametric functionals JMLR 2021
Histogram Transform Ensembles for Large-scale Regression JMLR 2021
Optimization with Momentum: Dynamical, Control-Theoretic, and Symplectic Perspectives JMLR 2021
Path Length Bounds for Gradient Descent and Flow JMLR 2021
Nonlinear Two-Time-Scale Stochastic Approximation: Convergence and Finite-Time Performance L4DC 2021
CANITA: Faster Rates for Distributed Convex Optimization with Communication Compression NIPS 2021
Understanding the Effect of Stochasticity in Policy Optimization NIPS 2021
Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update NIPS 2021
Improved Penalty Method via Doubly Stochastic Gradients for Bilevel Hyperparameter Optimization AAAI 2021
An Analysis of the Adaptation Speed of Causal Models AISTATS 2021
Homeomorphic-Invariance of EM: Non-Asymptotic Convergence in KL Divergence for Exponential Families via Mirror Descent AISTATS 2021
An Improved Analysis of Gradient Tracking for Decentralized Machine Learning NIPS 2021