conftrace_

inference efficiency

248 papers

Explore in graph

Co-occurring keywords

model compression (3302) large language model (13587) knowledge distillation (3725) inference optimization (219) kv cache (74) efficient computing (781) language model (4599) inference acceleration (244) attention mechanism (4001) neural network (6616)

Papers

Exploring the Boundaries of Low-Resource BERT Distillation EMNLP 2020
SqueezeBERT: What can computer vision teach NLP about efficient neural networks? EMNLP 2020
Layerwise Sparse Coding for Pruned Deep Neural Networks with Extreme Compression Ratio AAAI 2020
Rank and run-time aware compression of NLP Applications EMNLP 2020
Learning Efficient Task-Specific Meta-Embeddings with Word Prisms COLING 2020
BERT Loses Patience: Fast and Robust Inference with Early Exit NIPS 2020
Early Exiting BERT for Efficient Document Ranking EMNLP 2020
Speed-optimized, Compact Student Models that Distill Knowledge from a Larger Teacher Model: the UEDIN-CUNI Submission to the WMT 2020 News Translation Task EMNLP 2020
Abusive Language Detection using Syntactic Dependency Graphs EMNLP 2020
The Cascade Transformer: an Application for Efficient Answer Sentence Selection ACL 2020
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference EMNLP 2020
Rigging the Lottery: Making All Tickets Winners ICML 2020
Efficient EUD Parsing ACL 2020
Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction EMNLP 2020
Fully Quantized Network for Object Detection CVPR 2019
Dynamic-Net: Tuning the Objective Without Re-Training for Synthesis Tasks ICCV 2019
Shallow-Deep Networks: Understanding and Mitigating Network Overthinking ICML 2019
Balanced Sparsity for Efficient DNN Inference on GPU AAAI 2019
The streaming rollout of deep networks - towards fully model-parallel execution NIPS 2018
Pieces of Eight: 8-bit Neural Machine Translation NAACL 2018
Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks CVPR 2018
Efficient Attention using a Fixed-Size Memory Representation EMNLP 2017
Adaptive Neural Networks for Efficient Inference ICML 2017