← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

TinyBERT: Distilling BERT for Natural Language Understanding EMNLP 2020
HW-TSC’s Participation in the WMT 2020 News Translation Shared Task EMNLP 2020
The Volctrans Machine Translation System for WMT20 EMNLP 2020
Adapting Grad-CAM for Embedding Networks WACV 2020
A Joint Learning Approach based on Self-Distillation for Keyphrase Extraction from Scientific Documents COLING 2020
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression COLING 2020
KD-MRI: A knowledge distillation framework for image reconstruction and image restoration in MRI workflow MIDL 2020
PublishInCovid19 at WNUT 2020 Shared Task-1: Entity Recognition in Wet Lab Protocols using Structured Learning Ensemble and Contextualised Embeddings EMNLP 2020
Temporal-Context Enhanced Detection of Heavily Occluded Pedestrians CVPR 2020
Regularizing Class-Wise Predictions via Self-Knowledge Distillation CVPR 2020
Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020
Can Automatic Post-Editing Improve NMT? EMNLP 2020
Self-Training With Noisy Student Improves ImageNet Classification CVPR 2020
Collective Wisdom: Improving Low-resource Neural Machine Translation using Adaptive Knowledge Distillation COLING 2020
Language Model Prior for Low-Resource Neural Machine Translation EMNLP 2020
Improving Word Embedding Factorization for Compression Using Distilled Nonlinear Neural Decomposition EMNLP 2020
NLP@JUST at SemEval-2020 Task 4: Ensemble Technique for BERT and Roberta to Evaluate Commonsense Validation SEMEVAL 2020
Distill and Replay for Continual Language Learning COLING 2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification Using Pre-trained Language Models COLING 2020
Generalized Bayesian Posterior Expectation Distillation for Deep Neural Networks UAI 2020
Lifelong Language Knowledge Distillation EMNLP 2020
Distilling Multiple Domains for Neural Machine Translation EMNLP 2020
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation ACL 2020
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation EMNLP 2020
Query Distillation: BERT-based Distillation for Ensemble Ranking COLING 2020