speculative decoding

Lossless Acceleration of Large Language Models with Hierarchical Drafting based on Temporal Locality in Speculative Decoding NAACL 2025 MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding ICLR 2025 Mamba Drafters for Speculative Decoding EMNLP 2025 MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models EMNLP 2025 Mixture of Attentions For Speculative Decoding ICLR 2025 Multi-Branch Self-Drafting for LLM Inference Acceleration AAAI 2025 Optimized Multi-Token Joint Decoding With Auxiliary Model for LLM Inference ICLR 2025 PEARL: Parallel Speculative Decoding with Adaptive Draft Length ICLR 2025 PipeSpec: Breaking Stage Dependencies in Hierarchical LLM Decoding ACL 2025 PLD+: Accelerating LLM Inference by Leveraging Language Model Artifacts NAACL 2025 polybasic Speculative Decoding Through a Theoretical Perspective ICML 2025 QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025 RAPID: Long-Context Inference with Retrieval-Augmented Speculative Decoding ICML 2025 RASD: Retrieval-Augmented Speculative Decoding ACL 2025 Reward-Guided Speculative Decoding for Efficient LLM Reasoning ICML 2025 Root Defense Strategies: Ensuring Safety of LLM at the Decoding Level ACL 2025 SAM Decoding: Speculative Decoding via Suffix Automaton ACL 2025 SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding COLING 2025 Semi-Clairvoyant Scheduling of Speculative Decoding Requests to Minimize LLM Inference Latency IJCAI 2025 Simultaneous Masked and Unmasked Decoding with Speculative Decoding Masking for Fast ASR without Accuracy Loss Interspeech 2025 Sparse-to-Dense: A Free Lunch for Lossless Acceleration of Video Understanding in LLMs ACL 2025 SpecCoT: Accelerating Chain-of-Thought Reasoning through Speculative Exploration EMNLP 2025 SPECTRA: Faster Large Language Model Inference with Optimized Internal and External Speculation ACL 2025 Speculative Decoding for Multi-Sample Inference EMNLP 2025 Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion NAACL 2025