← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Industry Scale Semi-Supervised Learning for Natural Language Understanding NAACL 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
Papago’s Submission for the WMT21 Quality Estimation Shared Task EMNLP 2021
The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task EMNLP 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Simple and Efficient ways to Improve REALM EMNLP 2021
iFacetSum: Coreference-based Interactive Faceted Summarization for Multi-Document Exploration EMNLP 2021
CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Collaborative Group Learning AAAI 2021
YOLObile: Real-Time Object Detection on Mobile Devices via Compression-Compilation Co-Design AAAI 2021
Future-Guided Incremental Transformer for Simultaneous Translation AAAI 2021
Learning Light-Weight Translation Models from Deep Transformer AAAI 2021
Judgment Prediction via Injecting Legal Knowledge into Neural Networks AAAI 2021
ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques AAAI 2021
Data and Model Distillation as a Solution for Domain-transferable Fact Verification NAACL 2021
Modality-specific Distillation NAACL 2021
Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures AAAI 2021
Noisy Self-Knowledge Distillation for Text Summarization NAACL 2021
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation AAAI 2021
D3D: Distilled 3D Networks for Video Action Recognition WACV 2020
Load What You Need: Smaller Versions of Mutililingual BERT EMNLP 2020