conftrace_

inference optimization

219 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) efficient computing (781) kv cache (74) speculative decoding (111) language model (4599) inference efficiency (248) inference acceleration (244) efficient inference (233) memory efficiency (261)

Papers

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection EMNLP 2025
GraphKV: Breaking the Static Selection Paradigm with Graph-Based KV Cache Eviction EMNLP 2025
Lookahead Q-Cache: Achieving More Consistent KV Cache Eviction via Pseudo Query EMNLP 2025
ClusterAttn: KV Cache Compression under Intrinsic Attention Clustering ACL 2025
DAST: Difficulty-Adaptive Slow-Thinking for Large Reasoning Models EMNLP 2025
TopV: Compatible Token Pruning with Inference Time Optimization for Fast and Low-Memory Multimodal Vision Language Model CVPR 2025
Data-Free Group-Wise Fully Quantized Winograd Convolution via Learnable Scales CVPR 2025
Treasures in Discarded Weights for LLM Quantization AAAI 2025
Accelerating Diffusion Transformer via Gradient-Optimized Cache ICCV 2025
C3oT: Generating Shorter Chain-of-Thought Without Compromising Effectiveness AAAI 2025
SPECTRA: Faster Large Language Model Inference with Optimized Internal and External Speculation ACL 2025
Dynamic-Width Speculative Beam Decoding for LLM Inference AAAI 2025
FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference AACL 2025
Don’t Think It Twice: Exploit Shift Invariance for Efficient Online Streaming Inference of CNNs AAAI 2025
HARP: Hesitation-Aware Reframing in Transformer Inference Pass NAACL 2025
Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success RSS 2025
SiLQ: Simple Large Language Model Quantization-Aware Training IJCNLP 2025
PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint IJCNLP 2025
Exploring Hybrid Sampling Inference for Aspect-based Sentiment Analysis NAACL 2025
Energy Considerations of Large Language Model Inference and Efficiency Optimizations ACL 2025
EcoTune: Token-Efficient Multi-Fidelity Hyperparameter Optimization for Large Language Model Inference EMNLP 2025
AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time EMNLP 2025
Confidence-Aware Reasoning: Optimizing Self-Guided Thinking Trajectories in Large Reasoning Models EMNLP 2025
AdaDiff: Adaptive Step Selection for Fast Diffusion Models AAAI 2025
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding ACL 2024