Knowledge Distillation

Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation AAAI 2021 GhostBERT: Generate More Features with Cheap Operations for BERT ACL 2021 GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation EMNLP 2021 Graph-Free Knowledge Distillation for Graph Neural Networks IJCAI 2021 Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation ACL 2021 HAD-Net: A Hierarchical Adversarial Knowledge Distillation Network for Improved Enhanced Tumour Segmentation Without Post-Contrast Images MIDL 2021 Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures AAAI 2021 Hierarchical Self-supervised Augmented Knowledge Distillation IJCAI 2021 How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021 HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression EMNLP 2021 HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021 iFacetSum: Coreference-based Interactive Faceted Summarization for Multi-Document Exploration EMNLP 2021 IIRC: Incremental Implicitly-Refined Classification CVPR 2021 Improve Object Detection with Feature-based Knowledge Distillation: Towards Accurate and Efficient Detectors ICLR 2021 Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation EMNLP 2021 Improving Tree-Structured Decoder Training for Code Generation via Mutual Learning AAAI 2021 Improving Weakly Supervised Visual Grounding by Contrastive Knowledge Distillation CVPR 2021 In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ACL 2021 Industry Scale Semi-Supervised Learning for Natural Language Understanding NAACL 2021 In Factuality: Efficient Integration of Relevant Facts for Visual Question Answering ACL 2021 Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021 Informative and Controllable Opinion Summarization EACL 2021 Instance-Conditional Knowledge Distillation for Object Detection NeurIPS 2021 Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network AAAI 2021 Introspective Distillation for Robust Question Answering NeurIPS 2021