conftrace_

multi-device inference

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

time to first token (1) parallel transformer (1) tensor parallelism (1) inference latency (1)

Papers

Kraken: Inherently Parallel Transformers For Efficient Multi-Device Inference NeurIPS 2024