Stochastic Methods

Skew-symmetrically perturbed gradient flow for convex optimization ACML 2021 Smooth Bandit Optimization: Generalization to Holder Space AISTATS 2021 SNIPS: Solving Noisy Inverse Problems Stochastically NeurIPS 2021 Sparse sketches with small inversion bias COLT 2021 Speeding Up Transformer Training By Using Dataset Subsampling - An Exploratory Analysis EMNLP 2021 Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness ICML 2021 Stability and Generalization of Decentralized Stochastic Gradient Descent AAAI 2021 Stability and Generalization of Stochastic Gradient Methods for Minimax Problems ICML 2021 Stochastic Anderson Mixing for Nonconvex Stochastic Optimization NeurIPS 2021 Stochastic Bandits with Linear Constraints AISTATS 2021 Stochastic Iterative Graph Matching ICML 2021 Stochastic Multi-Armed Bandits with Unrestricted Delay Distributions ICML 2021 Stochastic Online Optimization using Kalman Recursion JMLR 2021 Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence NeurIPS 2021 Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence AISTATS 2021 Stochastic Proximal AUC Maximization JMLR 2021 Stochastic Proximal Methods for Non-Smooth Non-Convex Constrained Sparse Optimization JMLR 2021 STORM+: Fully Adaptive SGD with Recursive Momentum for Nonconvex Optimization NeurIPS 2021 Streaming k-PCA: Efficient guarantees for Oja’s algorithm, beyond rank-one updates COLT 2021 The Benefits of Implicit Regularization from SGD in Least Squares Problems NeurIPS 2021 The Implicit Bias of Minima Stability: A View from Function Space NeurIPS 2021 The Last-Iterate Convergence Rate of Optimistic Mirror Descent in Stochastic Variational Inequalities COLT 2021 The Min-Max Complexity of Distributed Stochastic Convex Optimization with Intermittent Communication COLT 2021 Time-independent Generalization Bounds for SGLD in Non-convex Settings NeurIPS 2021 Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies ICML 2021