conftrace_

staleness compensation

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

delay compensation (1) communication overlap (1) distributed deep learning (1) data parallelism (1) weight prediction (1) distributed training (1) neural network training (1)

Papers

SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training NeurIPS 2022