conftrace_

consumer-grade gpu

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

distributed llm serving (1) prefill-decode scheduling (1) transmission scheduling (1) inference latency optimization (1) chunking algorithm (1) evolutionary merging (1) multilingual (1) cross lingual (1) large language model (1) item response theory (1)

Papers

Distributed LLM Serving on Consumer-Grade GPUs by Reconciling Computation and Communication EMNLP 2025 MERGE$^3$: Efficient Evolutionary Merging on Consumer-grade GPUs ICML 2025