Skip to content
conftrace_

large language model inference

5 papers

Explore in graph

Also known as

LLM INFERENCE

Co-occurring keywords · papers mentioning both

large language model (2) statistical integrity (1) entropy-driven alignment (1) batch scheduling (1) throughput latency tradeoff (1) gpu compute utilization (1) inference scheduler (1) multi-fidelity optimization (1) modular framework (1) cost reduction (1)

Papers

EDSD: Entropy-Driven Design for Faster Speculative Decoding ACL 2026 Cache Saver: A Modular Framework for Efficient, Affordable, and Reproducible LLM Inference EMNLP 2025 EcoTune: Token-Efficient Multi-Fidelity Hyperparameter Optimization for Large Language Model Inference EMNLP 2025 Pushing the Limits of BFP on Narrow Precision LLM Inference AAAI 2025 Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve OSDI 2024