distributed training

Scalable Distributed DL Training: Batching Communication and Computation AAAI 2019 SimpleDet: A Simple and Versatile Distributed Framework for Object Detection and Instance Recognition JMLR 2019 Tiresias: A GPU Cluster Manager for Distributed Deep Learning NSDI 2019 Two Tiered Distributed Training Algorithm for Acoustic Modeling Interspeech 2019 Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP 2018 ATOMO: Communication-efficient Learning via Atomic Sparsification NeurIPS 2018 Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training ICLR 2018 DRACO: Byzantine-resilient Distributed Training via Redundant Gradients ICML 2018 Exploring Hidden Dimensions in Accelerating Convolutional Neural Networks ICML 2018 GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learning CoRL 2018 GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training NeurIPS 2018 Large scale distributed neural network training through online distillation ICLR 2018 Mesh-TensorFlow: Deep Learning for Supercomputers NeurIPS 2018 OpenSeq2Seq: Extensible Toolkit for Distributed and Mixed Precision Training of Sequence-to-Sequence Models ACL 2018 Pipe-SGD: A Decentralized Pipelined SGD Framework for Distributed Deep Net Training NeurIPS 2018 Post: Device Placement with Cross-Entropy Minimization and Proximal Policy Optimization NeurIPS 2018 Snap ML: A Hierarchical Framework for Machine Learning NeurIPS 2018 The Convergence of Sparsified Gradient Methods NeurIPS 2018 The Effect of Network Width on the Performance of Large-batch Training NeurIPS 2018 TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning NeurIPS 2017 A Communication-Efficient Parallel Algorithm for Decision Tree NeurIPS 2016 FireCaffe: Near-Linear Acceleration of Deep Neural Network Training on Compute Clusters CVPR 2016 TensorFlow: A System for Large-Scale Machine Learning OSDI 2016 Large-scale Distributed Dependent Nonparametric Trees ICML 2015 Deep learning with COTS HPC systems ICML 2013