conftrace_

speculative decoding

111 papers

Explore in graph

Also known as

SD

Co-occurring keywords

large language model (13587) inference acceleration (244) inference optimization (219) token generation (47) draft model (21) model compression (3302) model acceleration (80) language model (4599) autoregressive decoding (33) parallel decoding (74)

Papers

A Drop-In Solution for On-the-Fly Adaptation of Speculative Decoding in Large Language Models ACL 2025
SAM Decoding: Speculative Decoding via Suffix Automaton ACL 2025
Speculative Sampling via Exponential Races ACL 2025
MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models EMNLP 2025
PipeSpec: Breaking Stage Dependencies in Hierarchical LLM Decoding ACL 2025
Draft on the Fly: Adaptive Self-Speculative Decoding using Cosine Similarity EMNLP 2024
SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices NIPS 2024
Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exiting NIPS 2024
Towards Fast Multilingual LLM Inference: Speculative Decoding and Specialized Drafters EMNLP 2024
SLiM: Speculative Decoding with Hypothesis Reduction NAACL 2024
Cascade Speculative Drafting for Even Faster LLM Inference NIPS 2024
Nearest Neighbor Speculative Decoding for LLM Generation and Attribution NIPS 2024
Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation EMNLP 2024
SpecHub: Provable Acceleration to Multi-Draft Speculative Decoding EMNLP 2024
Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding EMNLP 2024
Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training EMNLP 2024
LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding ACL 2024
Generation Meets Verification: Accelerating Large Language Model Inference with Smart Parallel Auto-Correct Decoding ACL 2024
Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism ACL 2024
Speculative Contrastive Decoding ACL 2024
How Speculative Can Speculative Decoding Be? COLING 2024
The Mamba in the Llama: Distilling and Accelerating Hybrid Models NIPS 2024
A Theoretical Perspective for Speculative Decoding Algorithm NIPS 2024
Sequoia: Scalable and Robust Speculative Decoding NIPS 2024
MatFormer: Nested Transformer for Elastic Inference NIPS 2024