Distributed Optimization

Learning Efficient Parameter Server Synchronization Policies for Distributed SGD ICLR 2020 SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum ICLR 2020 A Linearly Convergent Proximal Gradient Algorithm for Decentralized Optimization NeurIPS 2019 ANYTIME MINIBATCH: EXPLOITING STRAGGLERS IN ONLINE DISTRIBUTED OPTIMIZATION ICLR 2019 Toward Understanding the Impact of Staleness in Distributed Machine Learning ICLR 2019 Accumulated Gradient Normalization ACML 2017 Collaborative Deep Learning in Fixed Topology Networks NeurIPS 2017 Asynchronous Parallel Greedy Coordinate Descent NeurIPS 2016 Feature-distributed sparse regression: a screen-and-clean approach NeurIPS 2016 NESTT: A Nonconvex Primal-Dual Splitting Method for Distributed and Stochastic Optimization NeurIPS 2016 Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization NeurIPS 2015 Communication Complexity of Distributed Convex Learning and Optimization NeurIPS 2015 Deep learning with Elastic Averaging SGD NeurIPS 2015 Extending Gossip Algorithms to Distributed Estimation of U-statistics NeurIPS 2015 Communication Efficient Distributed Machine Learning with the Parameter Server NeurIPS 2014 Median Selection Subset Aggregation for Parallel Inference NeurIPS 2014 Trading Computation for Communication: Distributed Stochastic Dual Coordinate Ascent NeurIPS 2013 Communication-Efficient Algorithms for Statistical Optimization NeurIPS 2012 Distributed Non-Stochastic Experts NeurIPS 2012 Large Scale Distributed Deep Networks NeurIPS 2012 Distributed Delayed Stochastic Optimization NeurIPS 2011 Hogwild!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent NeurIPS 2011 Parallelized Stochastic Gradient Descent NeurIPS 2010