conftrace_

inference optimization

219 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) efficient computing (781) kv cache (74) speculative decoding (111) language model (4599) inference efficiency (248) inference acceleration (244) efficient inference (233) memory efficiency (261)

Papers

Lethe: Layer- and Time-Adaptive KV Cache Pruning for Reasoning-Intensive LLM Serving AAAI 2026
KV Pareto: Systems-Level Optimization of KV Cache and Model Compression for Long Context Inference EACL 2026
Q Cache: Visual Attention Is Valuable in Less than Half of Decode Layers for Multimodal Large Language Model AAAI 2026
Paths Not Taken: Structure-Based Pruning in PSDD Learning and Inference AAAI 2026
TimeBill: Time-Budgeted Inference for Large Language Models AAAI 2026
Token Pruning for Improving Graph-Generating State Space Model Performance EACL 2026
Confidence-Driven Multi-Scale Model Selection for Cost-Efficient Inference EACL 2026
LoResMT 2026 Shared Task System Description EACL 2026
Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression AAAI 2026
Algorithms for Context Engineering in LLM Inference: Optimization of Placement, Compression, and Scheduling AAAI 2026
SubGCache: Accelerating Graph-based RAG with Subgraph-level KV Cache AAAI 2026
KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inference AAAI 2026
Inference Scaling Law for Retrieval Augmented Generation AAAI 2026
Benchmarking the Energy Savings with Speculative Decoding Strategies EACL 2026
Entropy-Gated Branching for Efficient Test-Time Reasoning EACL 2026
Accurate KV Cache Quantization with Outlier Tokens Tracing ACL 2025
Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities? ACL 2025
PLADIS: Pushing the Limits of Attention in Diffusion Models at Inference Time by Leveraging Sparsity ICCV 2025
Dynamic-Width Speculative Beam Decoding for LLM Inference AAAI 2025
An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint EMNLP 2025
Don’t Think It Twice: Exploit Shift Invariance for Efficient Online Streaming Inference of CNNs AAAI 2025
MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference ACL 2025
Flaming-hot Initiation with Regular Execution Sampling for Large Language Models NAACL 2025
Unleashing Vecset Diffusion Model for Fast Shape Generation ICCV 2025
Exploring Hybrid Sampling Inference for Aspect-based Sentiment Analysis NAACL 2025