Skip to content
conftrace_

ring communication

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

sequence parallelism (1) ring self-attention (1) long sequence training (1) transformer model (1) long sequence (1) transformer optimization (1) memory efficiency (1) distributed training (1)

Papers

Sequence Parallelism: Long Sequence Training from System Perspective ACL 2023