inference optimization

Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU–GPU Hybrid Design OSDI 2026 Algorithms for Context Engineering in LLM Inference: Optimization of Placement, Compression, and Scheduling AAAI 2026 Benchmarking the Energy Savings with Speculative Decoding Strategies EACL 2026 Confidence-Driven Multi-Scale Model Selection for Cost-Efficient Inference EACL 2026 Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression AAAI 2026 Entropy-Gated Branching for Efficient Test-Time Reasoning EACL 2026 Inference Scaling Law for Retrieval Augmented Generation AAAI 2026 KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference AAAI 2026 KV Pareto: Systems-Level Optimization of KV Cache and Model Compression for Long Context Inference EACL 2026 Lethe: Layer- and Time-Adaptive KV Cache Pruning for Reasoning-Intensive LLM Serving AAAI 2026 LoResMT 2026 Shared Task System Description EACL 2026 Paths Not Taken: Structure-Based Pruning in PSDD Learning and Inference AAAI 2026 Q Cache: Visual Attention Is Valuable in Less than Half of Decode Layers for Multimodal Large Language Model AAAI 2026 SubGCache: Accelerating Graph-based RAG with Subgraph-level KV Cache AAAI 2026 TimeBill: Time-Budgeted Inference for Large Language Models AAAI 2026 Token Pruning for Improving Graph-Generating State Space Model Performance EACL 2026 γ-MoD: Exploring Mixture-of-Depth Adaptation for Multimodal Large Language Models ICLR 2025 Accelerate Parallelizable Reasoning via Parallel Decoding within One Sequence EMNLP 2025 Accelerating Diffusion Transformer via Gradient-Optimized Cache ICCV 2025 Accurate KV Cache Quantization with Outlier Tokens Tracing ACL 2025 AdaDiff: Adaptive Step Selection for Fast Diffusion Models AAAI 2025 Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Models AAAI 2025 A Drop-In Solution for On-the-Fly Adaptation of Speculative Decoding in Large Language Models ACL 2025 AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time EMNLP 2025 AnchorAttention: Difference-Aware Sparse Attention with Stripe Granularity EMNLP 2025