conftrace_

autoregressive decoding

33 papers

Explore in graph

Co-occurring keywords

speculative decoding (111) large language model (13587) inference acceleration (244) inference optimization (219) language model (4599) autoregressive model (456) text generation (2913) model compression (3302) parallel decoding (74) token generation (47)

Papers

ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval ACL 2026
HCSpec: Two-Tier Horizontal Cascade Speculative Decoding for High-Efficiency Large Language Model Inference ACL 2026
HeteroSpec: Leveraging Contextual Heterogeneity for Efficient Speculative Decoding ACL 2026
Martingale Foresight Sampling: A Principled Approach to Inference-Time LLM Decoding EACL 2026
Multi-Branch Self-Drafting for LLM Inference Acceleration AAAI 2025
Inferring from Logits: Exploring Best Practices for Decoding-Free Generative Candidate Selection ACL 2025
FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference IJCNLP 2025
Language Model Based Text-to-Audio Generation: Anti-Causally Aligned Collaborative Residual Transformers EMNLP 2025
Spec-VLA: Speculative Decoding for Vision-Language-Action Models with Relaxed Acceptance EMNLP 2025
Accelerated Test-Time Scaling with Model-Free Speculative Sampling EMNLP 2025
TTD-SQL: Tree-Guided Token Decoding for Efficient and Schema-Aware SQL Generation EMNLP 2025
FastVLM: Self-Speculative Decoding for Fast Vision-Language Model Inference AACL 2025
Decoding in Latent Spaces for Efficient Inference in LLM-based Recommendation EMNLP 2025
Adaptive Draft-Verification for Efficient Large Language Model Decoding AAAI 2025
PROMTEC: Fast LLM Inference Decoding using Prompt Multi-Lookup with Template Database and Common Sequences ACL 2025
Exploring the Hidden Capacity of LLMs for One-Step Text Generation EMNLP 2025
Reducing Transformer Key-Value Cache Size with Cross-Layer Attention NIPS 2024
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping EMNLP 2024
Lexical Substitution as Causal Language Modeling NAACL 2024
Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism ACL 2024
Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding ACL 2024
Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation EMNLP 2023
Accelerating Transformer Inference for Translation via Parallel Decoding ACL 2023
Treepiece: Faster Semantic Parsing via Tree Tokenization EMNLP 2023
MotionLM: Multi-Agent Motion Forecasting as Language Modeling ICCV 2023