conftrace_

prefill-decode scheduling

1 paper

Explore in graph

Co-occurring keywords · papers mentioning both

distributed llm serving (1) consumer-grade gpu (1) transmission scheduling (1) inference latency optimization (1) chunking algorithm (1)

Papers

Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication EMNLP 2025