Knowledge Distillation

Ego-Exo: Transferring Visual Representations From Third-Person to First-Person Videos CVPR 2021 Employing Argumentation Knowledge Graphs for Neural Argument Generation ACL 2021 Enhancing Diversity in Teacher-Student Networks via Asymmetric Branches for Unsupervised Person Re-Identification WACV 2021 Ensemble Attention Distillation for Privacy-Preserving Federated Learning ICCV 2021 Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021 ESPnet-ST IWSLT 2021 Offline Speech Translation System ACL 2021 EvDistill: Asynchronous Events To End-Task Learning via Bidirectional Reconstruction-Guided Cross-Modal Knowledge Distillation CVPR 2021 Even your Teacher Needs Guidance: Ground-Truth Targets Dampen Regularization Imposed by Self-Distillation NeurIPS 2021 Explainable Person Re-Identification With Attribute-Guided Metric Distillation ICCV 2021 Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation CVPR 2021 Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation ICCV 2021 Extremely Small BERT Models from Mixed-Vocabulary Training EACL 2021 Fair Feature Distillation for Visual Recognition CVPR 2021 FANS: Fusing ASR and NLU for On-Device SLU Interspeech 2021 Faster Matchings via Learned Duals NeurIPS 2021 FastSpeech 2: Fast and High-Quality End-to-End Text to Speech ICLR 2021 Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing NeurIPS 2021 Federated Model Distillation with Noise-Free Differential Privacy IJCAI 2021 Few-Shot Class-Incremental Learning via Relation Knowledge Distillation AAAI 2021 Finding Spoiler Bias in Tweets by Zero-shot Learning and Knowledge Distilling from Neural Text Simplification EACL 2021 FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout NeurIPS 2021 Future-Guided Incremental Transformer for Simultaneous Translation AAAI 2021 GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021 G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-Guided Feature Imitation ICCV 2021 General Instance Distillation for Object Detection CVPR 2021