Stochastic Methods

Second-Order Information in Non-Convex Stochastic Optimization: Power and Limitations COLT 2020 Semi-Supervised Bilingual Lexicon Induction with Two-way Interaction EMNLP 2020 SGD with shuffling: optimal rates without component convexity and large epoch requirements NeurIPS 2020 Simple and Fast Algorithm for Binary Integer and Online Linear Programming NeurIPS 2020 Sparse Parallel Training of Hierarchical Dirichlet Process Topic Models EMNLP 2020 Stochastic Approximate Gradient Descent via the Langevin Algorithm AAAI 2020 Stochastic Online Learning with Probabilistic Graph Feedback AAAI 2020 Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping NeurIPS 2020 Stochastic Optimization with Laggard Data Pipelines NeurIPS 2020 Stochastic Particle-Optimization Sampling and the Non-Asymptotic Convergence Theory AISTATS 2020 Stochastic Variance-Reduced Algorithms for PCA with Arbitrary Mini-Batch Sizes AISTATS 2020 Streaming Batch Gradient Tracking for Neural Network Training (Student Abstract) AAAI 2020 SVRG for Policy Evaluation with Fewer Gradient Evaluations IJCAI 2020 Temporal Variability in Implicit Online Learning NeurIPS 2020 The Devil is in the Detail: A Framework for Macroscopic Prediction via Microscopic Models NeurIPS 2020 The Error-Feedback framework: SGD with Delayed Gradients JMLR 2020 The Impact of Neural Network Overparameterization on Gradient Confusion and Stochastic Gradient Descent ICML 2020 Trading-Off Static and Dynamic Regret in Online Least-Squares and Beyond AAAI 2020 Training Keyword Spotting Models on Non-IID Data with Federated Learning Interspeech 2020 Unbalanced Sobolev Descent NeurIPS 2020 Uncorrected Least-Squares Temporal Difference with Lambda-Return AAAI 2020 Variance Reduction for Evolution Strategies via Structured Control Variates AISTATS 2020 Weighted Sampling for Combined Model Selection and Hyperparameter Tuning AAAI 2020 What You See May Not Be What You Get: UCB Bandit Algorithms Robust to ε-Contamination UAI 2020 Accelerated Linear Convergence of Stochastic Momentum Methods in Wasserstein Distances ICML 2019