conftrace_
← Learning Types
Deep Learning › Learning Types ›

Knowledge Distillation

1,329 papers

Papers per year

1
3
10
12
47
120
155
197
206
255
290
33

Papers

Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021
Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021
Student-Teacher Learning From Clean Inputs to Noisy Inputs CVPR 2021
Distilling Linguistic Context for Language Model Compression EMNLP 2021
RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking EMNLP 2021
GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021
Mutual-Learning Improves End-to-End Speech Translation EMNLP 2021
Structural Adapters in Pretrained Language Models for AMR-to-Text Generation EMNLP 2021
PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021
GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks EMNLP 2021
Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation EMNLP 2021
Editing Factual Knowledge in Language Models EMNLP 2021
Towards Zero-Shot Knowledge Distillation for Natural Language Processing EMNLP 2021
Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021
Distilling Relation Embeddings from Pretrained Language Models EMNLP 2021
Exploring Non-Autoregressive Text Style Transfer EMNLP 2021
Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias EMNLP 2021
Finetuning Pretrained Transformers into RNNs EMNLP 2021
N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021
DomiKnowS: A Library for Integration of Symbolic Domain Knowledge in Deep Learning EMNLP 2021
deepQuest-py: Large and Distilled Models for Quality Estimation EMNLP 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
Winnowing Knowledge for Multi-choice Question Answering EMNLP 2021