conftrace_

ring self-attention

1 paper

Explore in graph

Also known as

RSA

Co-occurring keywords · papers mentioning both

long sequence training (1) sequence parallelism (1) ring communication (1) transformer model (1) long sequence (1) transformer optimization (1) memory efficiency (1) distributed training (1)

Papers

Sequence Parallelism: Long Sequence Training from System Perspective ACL 2023