Skip to content
conftrace_

efficient decoding

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (3) large language model (2) beam search (2) efficient inference (2) neural machine translation (2) variable-length decoding (1) cpu decoding (1) batched beam search (1) pooled data (1) transformer model (1)

Papers

Evolving Sparsity: Leveraging Token Importance Dynamics for Efficient LLM Decoding with Sparse Attention ACL 2026 LeanK: Learnable K Cache Channel Pruning for Efficient Decoding EMNLP 2025 Near optimal efficient decoding from pooled data COLT 2022 A Streaming Approach For Efficient Batched Beam Search EMNLP 2020 Efficient and High-Quality Neural Machine Translation with OpenNMT ACL 2020 Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU EMNLP 2017