conftrace_

inference optimization

219 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) efficient computing (781) kv cache (74) speculative decoding (111) language model (4599) inference efficiency (248) inference acceleration (244) efficient inference (233) memory efficiency (261)

Papers

A-VL: Adaptive Attention for Large Vision-Language Models AAAI 2025
Answer Convergence as a Signal for Early Stopping in Reasoning EMNLP 2025
Fuzzy Speculative Decoding for a Tunable Accuracy-Runtime Tradeoff ACL 2025
SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding COLING 2025
Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities? ACL 2025
Data-Free Group-Wise Fully Quantized Winograd Convolution via Learnable Scales CVPR 2025
AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time EMNLP 2025
Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppression EMNLP 2025
Accurate KV Cache Quantization with Outlier Tokens Tracing ACL 2025
TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model CVPR 2025
DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models EMNLP 2025
MiniKV: Pushing the Limits of 2-Bit KV Cache via Compression and System Co-Design for Efficient Long Context Inference ACL 2025
Cacheback: Speculative Decoding With Nothing But Cache EMNLP 2025
Not All Layers of LLMs Are Necessary During Inference IJCAI 2025
Verbosity-Aware Rationale Reduction: Sentence-Level Rationale Reduction for Efficient and Effective Reasoning ACL 2025
TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization ACL 2025
Brevity is the soul of sustainability: Characterizing LLM response lengths ACL 2025
SpindleKV: A Novel KV Cache Reduction Method Balancing Both Shallow and Deep Layers ACL 2025
TETRIS: Optimal Draft Token Selection for Batch Speculative Decoding ACL 2025
An Empirical Study of LLM Reasoning Ability Under Strict Output Length Constraint EMNLP 2025
Draft Model Knows When to Stop: Self-Verification Speculative Decoding for Long-Form Generation EMNLP 2025
CLaSp: In-Context Layer Skip for Self-Speculative Decoding ACL 2025
Stepwise Reasoning Checkpoint Analysis: A Test Time Scaling Method to Enhance LLMs’ Reasoning EMNLP 2025
TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text EMNLP 2025
TaDA: Training-free recipe for Decoding with Adaptive KV Cache Compression and Mean-centering ACL 2025