inference acceleration

Mixture of Attentions For Speculative Decoding ICLR 2025 Multi-Branch Self-Drafting for LLM Inference Acceleration AAAI 2025 PatchScaler: An Efficient Patch-Independent Diffusion Model for Image Super-Resolution ICCV 2025 PEARL: Parallel Speculative Decoding with Adaptive Draft Length ICLR 2025 PLD+: Accelerating LLM Inference by Leveraging Language Model Artifacts NAACL 2025 Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference AAAI 2025 PROMTEC: Fast LLM Inference Decoding using Prompt Multi-Lookup with Template Database and Common Sequences ACL 2025 ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models COLING 2025 QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025 QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation ICCV 2025 Quantization without Tears CVPR 2025 Radar: Fast Long-Context Decoding for Any Transformer ICLR 2025 RASD: Retrieval-Augmented Speculative Decoding ACL 2025 RedundancyLens: Revealing and Exploiting Visual Token Processing Redundancy for Efficient Decoder-Only MLLMs ACL 2025 Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inference ICLR 2025 RotateKV: Accurate and Robust 2-Bit KV Cache Quantization for LLMs via Outlier-Aware Adaptive Rotations IJCAI 2025 Round Attention: A Novel Round-Level Attention Mechanism to Accelerate LLM Inference ACML 2025 SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration ICLR 2025 SAM Decoding: Speculative Decoding via Suffix Automaton ACL 2025 SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding COLING 2025 Skip-Vision: Efficient and Scalable Acceleration of Vision-Language Models via Adaptive Token Skipping ICCV 2025 SparseMM: Head Sparsity Emerges from Visual Concept Responses in MLLMs ICCV 2025 Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs ACL 2025 Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion NAACL 2025 Speculative Safety-Aware Decoding EMNLP 2025