conftrace_

inference speedup

37 papers

Explore in graph

Co-occurring keywords

model compression (3302) inference acceleration (244) large language model (13587) diffusion model (3751) inference speed (96) knowledge distillation (3725) transformer model (1996) early exit (79) automatic speech recognition (1774) neural machine translation (2310)

Papers

Pruning Neural Machine Translation for Speed Using Group Lasso EMNLP 2021
LeeBERT: Learned Early Exit for BERT with cross-level optimization IJCNLP 2021
Group Fisher Pruning for Practical Network Compression ICML 2021
Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-End Speech Recognition INTERSPEECH 2021
Early Exiting BERT for Efficient Document Ranking EMNLP 2020
Learning to Recover from Multi-Modality Errors for Non-Autoregressive Neural Machine Translation ACL 2020
Transformer-based Double-token Bidirectional Autoregressive Decoding in Neural Machine Translation AACL 2020
Sharing Attention Weights for Fast Transformer IJCAI 2019
Efficient Attention using a Fixed-Size Memory Representation EMNLP 2017
Binary Deep Neural Networks for Speech Recognition INTERSPEECH 2017
Tensor Decomposition for Fast Parsing with Latent-Variable PCFGs NIPS 2012
Why are DBNs sparse? AISTATS 2010