llm inference

Accelerating LLM Inference Throughput via Asynchronous KV Cache Prefetching AAAI 2026 ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs ACL 2026 StriaTrace: Efficient Tracing and Diagnosis for Online LLM Inference (Operational Systems) OSDI 2026 TokenPowerBench: Benchmarking the Power Consumption of LLM Inference AAAI 2026 Are Optimal Algorithms Still Optimal? Rethinking Sorting in LLM-Based Pairwise Ranking with Batching and Caching ACL 2025 EcoTune: Token-Efficient Multi-Fidelity Hyperparameter Optimization for Large Language Model Inference EMNLP 2025 EvolKV: Evolutionary KV Cache Compression for LLM Inference EMNLP 2025 FPE2M2: Approaching Lossless and Efficient Quantization with Native Floating Point ACL 2025 Mitigating Hallucination by Integrating Knowledge Graphs into LLM Inference – a Systematic Literature Review ACL 2025 PLD+: Accelerating LLM Inference by Leveraging Language Model Artifacts NAACL 2025 Reasoning under Uncertainty: Efficient LLM Inference via Unsupervised Confidence Dilution and Convergent Adaptive Sampling EMNLP 2025 Scaling LLM Inference Efficiently with Optimized Sample Compute Allocation NAACL 2025 Speculative Prefill: Turbocharging TTFT with Lightweight and Training-Free Token Importance Estimation ICML 2025 ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction NeurIPS 2024 Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference ICML 2024 Regression Aware Inference with LLMs EMNLP 2024 SparQ Attention: Bandwidth-Efficient LLM Inference ICML 2024