Knowledge Distillation

The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022 ToKen: Task Decomposition and Knowledge Infusion for Few-Shot Hate Speech Detection EMNLP 2022 Towards Data-Free Domain Generalization ACML 2022 Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations ICLR 2022 A teacher-student framework to distill future trajectories ICLR 2021 Co-Teaching Student-Model through Submission Results of Shared Task EMNLP 2021 Distilling Knowledge from Reader to Retriever for Question Answering ICLR 2021 Generalization bounds via distillation ICLR 2021 How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021 Interpretable Embedding Procedure Knowledge Transfer via Stacked Principal Component Analysis and Graph Neural Network AAAI 2021 Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation EMNLP 2021 LMdiff: A Visual Diff Tool to Compare Language Models EMNLP 2021 Object DGCNN: 3D Object Detection using Dynamic Graphs NeurIPS 2021 On Knowledge Distillation for Translating Erroneous Speech Transcriptions ACL 2021 On Learning the Geodesic Path for Incremental Learning CVPR 2021 Reinforced Multi-Teacher Selection for Knowledge Distillation AAAI 2021 RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation EMNLP 2021 Teacher Guided Neural Architecture Search for Face Recognition AAAI 2021 Towards Quantifiable Dialogue Coherence Evaluation ACL 2021 Universal-KD: Attention-based Output-Grounded Intermediate Layer Knowledge Distillation EMNLP 2021 A2dele: Adaptive and Attentive Depth Distiller for Efficient RGB-D Salient Object Detection CVPR 2020 Distilling Neural Networks for Greener and Faster Dependency Parsing ACL 2020 ECNU-SenseMaker at SemEval-2020 Task 4: Leveraging Heterogeneous Knowledge Resources for Commonsense Validation and Explanation SemEval 2020 Long Short-Term Sample Distillation AAAI 2020 Maintaining Discrimination and Fairness in Class Incremental Learning CVPR 2020