inference acceleration

AirCache: Activating Inter-modal Relevancy KV Cache Compression for Efficient Large Vision-Language Model Inference ICCV 2025 Alignment-Augmented Speculative Decoding with Alignment Sampling and Conditional Verification EMNLP 2025 Amphista: Bi-directional Multi-head Decoding for Accelerating LLM Inference NAACL 2025 Apollo-Forecast: Overcoming Aliasing and Inference Speed Challenges in Language Models for Time Series Forecasting AAAI 2025 BlockDance: Reuse Structurally Similar Spatio-Temporal Features to Accelerate Diffusion Transformers CVPR 2025 Block Verification Accelerates Speculative Decoding ICLR 2025 Boosting Multimodal Large Language Models with Visual Tokens Withdrawal for Rapid Inference AAAI 2025 Cacheback: Speculative Decoding With Nothing But Cache EMNLP 2025 CLaSp: In-Context Layer Skip for Self-Speculative Decoding ACL 2025 Conical Visual Concentration for Efficient Large Vision-Language Models CVPR 2025 Consultant Decoding: Yet Another Synergistic Mechanism ACL 2025 CopySpec: Accelerating LLMs with Speculative Copy-and-Paste EMNLP 2025 CORAL: Learning Consistent Representations across Multi-step Training with Lighter Speculative Drafter ACL 2025 DAM: Dynamic Attention Mask for Long-Context Large Language Model Inference Acceleration ACL 2025 Dovetail: A CPU/GPU Heterogeneous Speculative Decoding for LLM inference EMNLP 2025 DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Models CVPR 2025 DynPose: Largely Improving the Efficiency of Human Pose Estimation by a Simple Dynamic Framework CVPR 2025 EAC-MoE: Expert-Selection Aware Compressor for Mixture-of-Experts Large Language Models ACL 2025 EEdit : Rethinking the Spatial and Temporal Redundancy for Efficient Image Editing ICCV 2025 Efficient Inference for Large Language Model-based Generative Recommendation ICLR 2025 Efficient Unstructured Pruning of Mamba State-Space Models for Resource-Constrained Environments EMNLP 2025 EMS-SD: Efficient Multi-sample Speculative Decoding for Accelerating Large Language Models NAACL 2025 Falcon: Faster and Parallel Inference of Large Language Models Through Enhanced Semi-Autoregressive Drafting and Custom-Designed Decoding Tree AAAI 2025 FastDraft: How to Train Your Draft ACL 2025 FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference IJCNLP 2025