conftrace_

asynchronous gradient descent

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

distributed learning (2) coded computation (1) continuous approximation (1) stochastic differential delay equation (1) asynchronous stochastic gradient descent (1) lossy compression (1) transformer training (1) transformer optimization (1) model convergence (1) straggler mitigation (1)

Papers

Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent ICML 2022 Making Asynchronous Stochastic Gradient Descent Work for Transformers EMNLP 2019 Differential Equations for Modeling Asynchronous Algorithms IJCAI 2018