← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

TenTrans High-Performance Inference Toolkit for WMT2021 Efficiency Task EMNLP 2021
Papago’s Submission for the WMT21 Quality Estimation Shared Task EMNLP 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
SuperMix: Supervising the Mixing Data Augmentation CVPR 2021
Complementary Relation Contrastive Distillation CVPR 2021
Wasserstein Contrastive Representation Distillation CVPR 2021
IIRC: Incremental Implicitly-Refined Classification CVPR 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning ICML 2021
BART-TL: Weakly-Supervised Topic Label Generation EACL 2021
KACE: Generating Knowledge Aware Contrastive Explanations for Natural Language Inference IJCNLP 2021
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains IJCNLP 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task IJCNLP 2021
Refining Sample Embeddings with Relation Prototypes to Enhance Continual Relation Extraction IJCNLP 2021
Weight Distillation: Transferring the Knowledge in Neural Network Parameters IJCNLP 2021
Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation IJCNLP 2021
Obtaining Better Static Word Embeddings Using Contextual Embedding Models IJCNLP 2021
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor IJCNLP 2021
Dealing with training and test segmentation mismatch: FBK@IWSLT2021 IJCNLP 2021
ESPnet-ST IWSLT 2021 Offline Speech Translation System IJCNLP 2021
In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval IJCNLP 2021
Unsupervised Multi-Target Domain Adaptation Through Knowledge Distillation WACV 2021
Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift ICCV 2021
Multi-Domain Knowledge Distillation via Uncertainty-Matching for End-to-End ASR Models INTERSPEECH 2021
Ultra Fast Speech Separation Model with Teacher Student Learning INTERSPEECH 2021
Learning a Neural Diff for Speech Models INTERSPEECH 2021