Knowledge Distillation

Improving End-to-End Speech Translation by Imitation-Based Knowledge Distillation with Synthetic Transcripts ACL 2023 Improving Knowledge Graph Completion with Generative Hard Negative Mining ACL 2023 Improving Prediction Backward-Compatiblility in NLP Model Upgrade with Gated Fusion EACL 2023 Improving Simultaneous Machine Translation with Monolingual Data AAAI 2023 Incorporating Ultrasound Tongue Images for Audio-Visual Speech Enhancement through Knowledge Distillation Interspeech 2023 Incorporating Unlikely Negative Cues for Distinctive Image Captioning IJCAI 2023 Incrementer: Transformer for Class-Incremental Semantic Segmentation With Knowledge Distillation Focusing on Old Class CVPR 2023 InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT EMNLP 2023 Injecting knowledge into language generation: a case study in auto-charting after-visit care instructions from medical dialogue ACL 2023 Instance-aware Dynamic Prompt Tuning for Pre-trained Point Cloud Models ICCV 2023 Integrating Translation Memories into Non-Autoregressive Machine Translation EACL 2023 Intuitive Access to Smartphone Settings Using Relevance Model Trained by Contrastive Learning AAAI 2023 Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents EMNLP 2023 IterDE: An Iterative Knowledge Distillation Framework for Knowledge Graph Embeddings AAAI 2023 itKD: Interchange Transfer-Based Knowledge Distillation for 3D Object Detection CVPR 2023 Jaccard Metric Losses: Optimizing the Jaccard Index with Soft Labels NeurIPS 2023 KD-Boost: Boosting Real-Time Semantic Matching in E-commerce with Knowledge Distillation EMNLP 2023 KD-DLGAN: Data Limited Image Generation via Knowledge Distillation CVPR 2023 KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs NeurIPS 2023 KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction AAAI 2023 Knowledge Amalgamation for Multi-Label Classification via Label Dependency Transfer AAAI 2023 Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive Tasks NeurIPS 2023 Knowledge Diffusion for Distillation NeurIPS 2023 Knowledge Distillation Approach for Efficient Internal Language Model Estimation Interspeech 2023 Knowledge Distillation for 6D Pose Estimation by Aligning Distributions of Local Predictions CVPR 2023