conftrace_

communication overlap

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

staleness compensation (1) delay compensation (1) distributed deep learning (1) data parallelism (1) weight prediction (1) distributed training (1) neural network training (1)

Papers

SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training NeurIPS 2022