inference speedup

Accelerating Transducers through Adjacent Token Merging Interspeech 2023 Bridging the Granularity Gap for Acoustic Modeling ACL 2023 DeepPCR: Parallelizing Sequential Operations in Neural Networks NeurIPS 2023 GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints EMNLP 2023 LECO: Improving Early Exiting via Learned Exits and Comparison-based Exiting Mechanism ACL 2023 MUX-PLMs: Data Multiplexing for High-throughput Language Models EMNLP 2023 Structured Pruning for Efficient Generative Pre-trained Language Models ACL 2023 AdapLeR: Speeding up Inference by Adaptive Length Reduction ACL 2022 Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022 SPDY: Accurate Pruning with Speedup Guarantees ICML 2022 Transkimmer: Transformer Learns to Layer-wise Skim ACL 2022 Understanding the Role of Self Attention for Efficient Speech Recognition ICLR 2022 XLM-D: Decorate Cross-lingual Pre-training Model as Non-Autoregressive Neural Machine Translation EMNLP 2022 Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-End Speech Recognition Interspeech 2021 Group Fisher Pruning for Practical Network Compression ICML 2021 Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP 2021 Early Exiting BERT for Efficient Document Ranking EMNLP 2020 Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation ACL 2020 Transformer-based Double-token Bidirectional Autoregressive Decoding in Neural Machine Translation AACL 2020 Sharing Attention Weights for Fast Transformer IJCAI 2019 Binary Deep Neural Networks for Speech Recognition Interspeech 2017 Efficient Attention using a Fixed-Size Memory Representation EMNLP 2017 Tensor Decomposition for Fast Parsing with Latent-Variable PCFGs NeurIPS 2012 Why are DBNs sparse? AISTATS 2010