inference speed

Non-Autoregressive Machine Translation: It’s Not as Fast as it Seems NAACL 2022 Non-Autoregressive Models for Fast Sequence Generation EMNLP 2022 Non-Autoregressive Neural Machine Translation: A Call for Clarity EMNLP 2022 PALBERT: Teaching ALBERT to Ponder NeurIPS 2022 RedApt: An Adaptor for wav2vec 2 EncodingFaster and Smaller Speech Translation without Quality Compromise EMNLP 2022 Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022 Speed Up Object Detection on Gigapixel-Level Images With Patch Arrangement CVPR 2022 The RoyalFlush System for the WMT 2022 Efficiency Task EMNLP 2022 Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation ICLR 2021 DRONE: Data-aware Low-rank Compression for Large NLP Models NeurIPS 2021 Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-End Speech Recognition Interspeech 2021 Efficient Inference for Multilingual Neural Machine Translation EMNLP 2021 EL-Attention: Memory Efficient Lossless Attention for Generation ICML 2021 LeViT: A Vision Transformer in ConvNet's Clothing for Faster Inference ICCV 2021 Low-Rank Constraints for Fast Inference in Structured Models NeurIPS 2021 Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP 2021 RepVGG: Making VGG-Style ConvNets Great Again CVPR 2021 Rethinking BiSeNet for Real-Time Semantic Segmentation CVPR 2021 Streaming End-to-End ASR Based on Blockwise Non-Autoregressive Models Interspeech 2021 DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference ACL 2020 Distilling Neural Networks for Greener and Faster Dependency Parsing ACL 2020 Dynamic Convolutions: Exploiting Spatial Sparsity for Faster Inference CVPR 2020 Efficient Inference For Neural Machine Translation EMNLP 2020 Efficient WaveGlow: An Improved WaveGlow Vocoder with Enhanced Speed Interspeech 2020