← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction CONLL 2020
Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription INTERSPEECH 2020
Improving Low Resource Code-Switched ASR Using Augmented Code-Switched TTS INTERSPEECH 2020
Why Skip If You Can Combine: A Simple Knowledge Distillation Technique for Intermediate Layers EMNLP 2020
Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation ACL 2020
Balancing Cost and Benefit with Tied-Multi Transformers ACL 2020
CASIA’s System for IWSLT 2020 Open Domain Translation ACL 2020
End-to-End Speech-Translation with Knowledge Distillation: FBK@IWSLT2020 ACL 2020
TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing ACL 2020
Distilling Knowledge Learned in BERT for Text Generation ACL 2020
FastBERT: a Self-distilling BERT with Adaptive Inference Time ACL 2020
Improving Non-autoregressive Neural Machine Translation with Monolingual Data ACL 2020
Distilling the Knowledge of BERT for Sequence-to-Sequence ASR INTERSPEECH 2020
Knowledge Distillation from Offline to Streaming RNN Transducer for End-to-End Speech Recognition INTERSPEECH 2020
Speech to Text Adaptation: Towards an Efficient Cross-Modal Distillation INTERSPEECH 2020
Collaborative Distillation for Ultra-Resolution Universal Style Transfer CVPR 2020
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices ACL 2020
XtremeDistil: Multi-stage Distillation for Massive Multilingual Models ACL 2020
Distilling Neural Networks for Greener and Faster Dependency Parsing ACL 2020
Variational Learning of Bayesian Neural Networks via Bayesian Dark Knowledge IJCAI 2020
The Knowledge Within: Methods for Data-Free Model Compression CVPR 2020
A "Network Pruning Network'' Approach to Deep Model Compression WACV 2020
Hybrid Models for Learning to Branch NIPS 2020
Distributed Distillation for On-Device Learning NIPS 2020
The NiuTrans System for WNGT 2020 Efficiency Task ACL 2020