conftrace_

inference latency optimization

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

distributed llm serving (1) consumer-grade gpu (1) prefill-decode scheduling (1) transmission scheduling (1) chunking algorithm (1)

Papers

Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication EMNLP 2025