inference efficiency

Rank and run-time aware compression of NLP Applications EMNLP 2020 Rigging the Lottery: Making All Tickets Winners ICML 2020 Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task EMNLP 2020 SqueezeBERT: What can computer vision teach NLP about efficient neural networks? EMNLP 2020 The Cascade Transformer: an Application for Efficient Answer Sentence Selection ACL 2020 The Right Tool for the Job: Matching Model and Instance Complexities ACL 2020 Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019 Dynamic-Net: Tuning the Objective Without Re-Training for Synthesis Tasks ICCV 2019 Fully Quantized Network for Object Detection CVPR 2019 Shallow-Deep Networks: Understanding and Mitigating Network Overthinking ICML 2019 Pieces of Eight: 8-bit Neural Machine Translation NAACL 2018 Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks CVPR 2018 The streaming rollout of deep networks - towards fully model-parallel execution NeurIPS 2018 Adaptive Neural Networks for Efficient Inference ICML 2017 Efficient Attention using a Fixed-Size Memory Representation EMNLP 2017