conftrace_
← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

3,086 papers

Papers per year

1
1
1
200
658
'00
'10
'15
'20
'25

Papers

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
Distilling Knowledge for Empathy Detection EMNLP 2021
Retrieval Augmentation Reduces Hallucination in Conversation EMNLP 2021
Parameter-Efficient Domain Knowledge Integration from Multiple Sources for Biomedical Pre-trained Language Models EMNLP 2021
Competing Independent Modules for Knowledge Integration and Optimization EMNLP 2021
Simple and Efficient ways to Improve REALM EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Semantic Categorization of Social Knowledge for Commonsense Question Answering EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021
NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021
The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task EMNLP 2021
TenTrans Large-Scale Multilingual Machine Translation System for WMT21 EMNLP 2021
Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
The NiuTrans System for the WMT 2021 Efficiency Task EMNLP 2021
Papago’s Submission for the WMT21 Quality Estimation Shared Task EMNLP 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
Perturbed Self-Distillation: Weakly Supervised Large-Scale Point Cloud Semantic Segmentation ICCV 2021
Densely Guided Knowledge Distillation Using Multiple Teacher Assistants ICCV 2021
G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-Guided Feature Imitation ICCV 2021
Revisiting Adversarial Robustness Distillation: Robust Soft Labels Make Student Better ICCV 2021
Lipschitz Continuity Guided Knowledge Distillation ICCV 2021
Distilling Virtual Examples for Long-Tailed Recognition ICCV 2021