← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

790 directly classified papers

Papers per year

Papers

Learning Multiple Adverse Weather Removal via Two-Stage Knowledge Learning and Multi-Contrastive Regularization: Toward a Unified Model CVPR 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent CVPR 2022
Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation CVPR 2022
Cross Domain Object Detection by Target-Perceived Dual Branch Distillation CVPR 2022
Learn From Others and Be Yourself in Heterogeneous Federated Learning CVPR 2022
Learning Structured Gaussians To Approximate Deep Ensembles CVPR 2022
Class-Incremental Learning by Knowledge Distillation With Adaptive Feature Consolidation CVPR 2022
Lipschitz Continuity Guided Knowledge Distillation ICCV 2021
KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation IJCAI 2021
Self-boosting for Feature Distillation IJCAI 2021
Distilling Linguistic Context for Language Model Compression EMNLP 2021
Mutual-Learning Improves End-to-End Speech Translation EMNLP 2021
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021
Editing Factual Knowledge in Language Models EMNLP 2021
Towards Zero-Shot Knowledge Distillation for Natural Language Processing EMNLP 2021
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021
Distilling Relation Embeddings from Pretrained Language Models EMNLP 2021
Exploring Non-Autoregressive Text Style Transfer EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learning EMNLP 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
Winnowing Knowledge for Multi-choice Question Answering EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021