conftrace_

asynchronous gradient descent

3 papers

Explore in graph

Co-occurring keywords

distributed learning (563) coded computation (9) continuous approximation (3) stochastic differential delay equation (1) asynchronous stochastic gradient descent (13) lossy compression (32) transformer training (13) transformer optimization (24) model convergence (39) straggler mitigation (22)

Papers

Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022

Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019

Differential Equations for Modeling Asynchronous Algorithms IJCAI 2018