Distributed Learning

Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts NeurIPS 2020 Twine: A Unified Cluster Management System for Shared Infrastructure OSDI 2020 Uncertain multi-agent MILPs: A data-driven decentralized solution with probabilistic feasibility guarantees L4DC 2020 WONDER: Weighted One-shot Distributed Ridge Regression in High Dimensions JMLR 2020 Write Dependency Disentanglement with HORAE OSDI 2020 Zeno++: Robust Fully Asynchronous SGD ICML 2020 Accelerated Decentralized Optimization with Local Updates for Smooth and Strongly Convex Objectives AISTATS 2019 A Communication Efficient Stochastic Multi-Block Alternating Direction Method of Multipliers NeurIPS 2019 A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification IJCAI 2019 A Highly Efficient Distributed Deep Learning System for Automatic Speech Recognition Interspeech 2019 A Little Is Enough: Circumventing Defenses For Distributed Learning NeurIPS 2019 An Accelerated Decentralized Stochastic Proximal Algorithm for Finite Sums NeurIPS 2019 Analysis of Quantized Models ICLR 2019 An asymptotic analysis of distributed nonparametric methods JMLR 2019 A Sharper Generalization Bound for Divide-and-Conquer Ridge Regression AAAI 2019 AutoML from Service Provider’s Perspective: Multi-device, Multi-tenant Model Selection with GP-EI AISTATS 2019 Bayesian Nonparametric Federated Learning of Neural Networks ICML 2019 BLAS-on-flash: An Efficient Alternative for Large Scale ML Training and Inference? NSDI 2019 Building Personalized Simulator for Interactive Search IJCAI 2019 Combining ADMM and the Augmented Lagrangian Method for Efficiently Handling Many Constraints IJCAI 2019 Combining Global Sparse Gradients with Local Gradients in Distributed Neural Network Training EMNLP 2019 Communication and Memory Efficient Testing of Discrete Distributions COLT 2019 Communication-Constrained Inference and the Role of Shared Randomness ICML 2019 Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback NeurIPS 2019 Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients NeurIPS 2019