Skip to content
conftrace_

decoding efficiency

7 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) neural machine translation (3) beam search (2) kv cache (2) retrieval-augmented generation (2) prediction decoder (1) attention approximation (1) efficient decoding (1) key-value memory (1) hypothesis recombination (1)

Papers

Adaptive Draft-Verification for Efficient Large Language Model Decoding AAAI 2025 LeanK: Learnable K Cache Channel Pruning for Efficient Decoding EMNLP 2025 MagicPIG: LSH Sampling for Efficient LLM Generation ICLR 2025 SEQ-former: A context-enhanced and efficient automatic speech recognition framework Interspeech 2024 Subset Retrieval Nearest Neighbor Machine Translation ACL 2023 Fast Nearest Neighbor Machine Translation ACL 2022 Exploring Recombination for Efficient Decoding of Neural Machine Translation EMNLP 2018