Stochastic Methods

Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization AAAI 2021 ErrorCompensatedX: error compensation for variance reduced algorithms NeurIPS 2021 Fast and Memory Efficient Differentially Private-SGD via JL Projections NeurIPS 2021 How Emotionally Stable is ALBERT? Testing Robustness with Stochastic Weight Averaging on a Sentiment Analysis Task EMNLP 2021 How far can we get with one GPU in 100 hours? CoAStaL at MultiIndicMT Shared Task ACL 2021 Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations NeurIPS 2021 Noise against noise: stochastic label noise helps combat inherent label noise ICLR 2021 Online stochastic gradient descent on non-convex losses from high-dimensional inference JMLR 2021 On the Origin of Implicit Regularization in Stochastic Gradient Descent ICLR 2021 Stochastic Anderson Mixing for Nonconvex Stochastic Optimization NeurIPS 2021 Three Operator Splitting with Subgradients, Stochastic Gradients, and Adaptive Learning Rates NeurIPS 2021 Amortized variance reduction for doubly stochastic objective UAI 2020 An Investigation Into the Stochasticity of Batch Whitening CVPR 2020 Bundle Adjustment on a Graph Processor CVPR 2020 Deep Reservoir Computing Meets 5G MIMO-OFDM Systems in Symbol Detection AAAI 2020 Faster Differentially Private Samplers via Rényi Divergence Analysis of Discretized Langevin MCMC NeurIPS 2020 Gradient Estimation with Stochastic Softmax Tricks NeurIPS 2020 Minibatch vs Local SGD for Heterogeneous Distributed Learning NeurIPS 2020 On the Discrepancy between the Theoretical Analysis and Practical Implementations of Compressed Communication for Distributed Deep Learning AAAI 2020 Robustness Analysis of Non-Convex Stochastic Gradient Descent using Biased Expectations NeurIPS 2020 Beating SGD Saturation with Tail-Averaging and Minibatching NeurIPS 2019 Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback NeurIPS 2019 Communication-Efficient Stochastic Gradient MCMC for Neural Networks AAAI 2019 Communication trade-offs for Local-SGD with large step size NeurIPS 2019 Deep Layers as Stochastic Solvers ICLR 2019