Skip to content
conftrace_

parallel decoding

81 papers

Papers

Lossless Acceleration of Large Language Model via Adaptive N-gram Parallel Decoding NAACL 2024 Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training EMNLP 2024 Masked AutoDecoder is Effective Multi-Task Vision Generalist CVPR 2024 MMM: Generative Masked Motion Model CVPR 2024 Non-autoregressive Sequence-to-Sequence Vision-Language Models CVPR 2024 Ouroboros: Generating Longer Drafts Phrase by Phrase for Faster Speculative Decoding EMNLP 2024 PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity Recognition NeurIPS 2024 PRoDeliberation: Parallel Robust Deliberation for End-to-End Spoken Language Understanding EMNLP 2024 Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines ICML 2024 Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation ICLR 2024 Tell What You Hear From What You See - Video to Audio Generation Through Text NeurIPS 2024 Towards Effective and Efficient Non-autoregressive Decoding Using Block-based Attention Mask Interspeech 2024 Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative Decoding ACL 2024 Accelerating Transformer Inference for Translation via Parallel Decoding ACL 2023 An Expression Tree Decoding Strategy for Mathematical Equation Generation EMNLP 2023 Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models ICML 2023 Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding EMNLP 2023 Fast Inference from Transformers via Speculative Decoding ICML 2023 Fast Sampling of Diffusion Models via Operator Learning ICML 2023 Plan-then-Seam: Towards Efficient Table-to-Text Generation EACL 2023 Uncertainty-Aware Image Captioning AAAI 2023 Directed Acyclic Transformer for Non-Autoregressive Machine Translation ICML 2022 Future Transformer for Long-Term Action Anticipation CVPR 2022 Helping the Weak Makes You Strong: Simple Multi-Task Learning Improves Non-Autoregressive Translators EMNLP 2022 InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model NeurIPS 2022