Distributed Learning

DSCOVR: Randomized Primal-Dual Block Coordinate Algorithms for Asynchronous Distributed Optimization JMLR 2019 Error Feedback Fixes SignSGD and other Gradient Compression Schemes ICML 2019 Exploiting Commutativity For Practical Fast Replication NSDI 2019 Exploring Fast and Communication-Efficient Algorithms in Large-Scale Distributed Networks AISTATS 2019 Extreme Stochastic Variational Inference: Distributed Inference for Large Scale Mixture Models AISTATS 2019 FABA: An Algorithm for Fast Aggregation against Byzantine Attacks in Distributed Neural Networks IJCAI 2019 Fall of Empires: Breaking Byzantine-tolerant SGD by Inner Product Manipulation UAI 2019 Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent IJCAI 2019 FreeFlow: Software-based Virtual RDMA Networking for Containerized Clouds NSDI 2019 Fully Distributed Bayesian Optimization with Stochastic Policies IJCAI 2019 Gossip-based Actor-Learner Architectures for Deep Reinforcement Learning NeurIPS 2019 GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism NeurIPS 2019 Heterogeneous Model Reuse via Optimizing Multiparty Multiclass Margin ICML 2019 Hydra: a federated resource manager for data-center scale analytics NSDI 2019 Improved Parallel Algorithms for Density-Based Network Clustering ICML 2019 Lagrange Coded Computing: Optimal Design for Resiliency, Security, and Privacy AISTATS 2019 Large-Scale Distributed Second-Order Optimization Using Kronecker-Factored Approximate Curvature for Deep Convolutional Neural Networks CVPR 2019 Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models NeurIPS 2019 Learning to Learn Gradient Aggregation by Gradient Descent IJCAI 2019 Lower Bounds for Locally Private Estimation via Communication Complexity COLT 2019 Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019 Multi-Agent Coordination under Uncertain Communication AAAI 2019 On Communication Complexity of Classification Problems COLT 2019 On Distributed Averaging for Stochastic k-PCA NeurIPS 2019 One-vs-All Models for Asynchronous Training: An Empirical Analysis Interspeech 2019