← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Efficient and High-Quality Neural Machine Translation with OpenNMT ACL 2020
Edinburgh’s Submissions to the 2020 Machine Translation Efficiency Task ACL 2020
Improving Event Detection via Open-domain Trigger Knowledge ACL 2020
Go From the General to the Particular: Multi-Domain Translation with Domain Transformation Networks AAAI 2020
Class-incremental Learning via Deep Model Consolidation WACV 2020
TKD: Temporal Knowledge Distillation for Active Perception WACV 2020
Light Multi-Segment Activation for Model Compression AAAI 2020
Knowledge As Priors: Cross-Modal Knowledge Generalization for Datasets Without Superior Knowledge CVPR 2020
The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding ACL 2020
Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ACL 2020
Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention NIPS 2020
Agree to Disagree: Adaptive Ensemble Knowledge Distillation in Gradient Space NIPS 2020
Acquiring Knowledge from Pre-Trained Model to Neural Machine Translation AAAI 2020
Spatio-Temporal Graph for Video Captioning With Knowledge Distillation CVPR 2020
Hierarchical Knowledge Squeezed Adversarial Network Compression AAAI 2020
Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020
MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers NIPS 2020
Compact Speaker Embedding: lrx-Vector INTERSPEECH 2020
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search NIPS 2020
FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction EMNLP 2020
Audio-Visual Model Distillation Using Acoustic Images WACV 2020
Conditional Response Augmentation for Dialogue Using Knowledge Distillation INTERSPEECH 2020
Ensemble of Students Taught by Probabilistic Teachers to Improve Speech Emotion Recognition INTERSPEECH 2020
Dual Policy Distillation IJCAI 2020
ConceptBert: Concept-Aware Representation for Visual Question Answering EMNLP 2020