Knowledge Distillation

Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023 Can LMs Learn New Entities from Descriptions? Challenges in Propagating Injected Knowledge ACL 2023 Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer NeurIPS 2023 CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss CVPR 2023 Chain of Thought Prompting Elicits Knowledge Augmentation ACL 2023 CKDST: Comprehensively and Effectively Distill Knowledge from Machine Translation to End-to-End Speech Translation ACL 2023 Class Attention Transfer Based Knowledge Distillation CVPR 2023 Class Lifelong Learning for Intent Detection via Structure Consolidation Networks ACL 2023 Class-relation Knowledge Distillation for Novel Class Discovery ICCV 2023 CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval CVPR 2023 CLRL-Tuning: A Novel Continual Learning Approach for Automatic Speech Recognition Interspeech 2023 Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering NeurIPS 2023 Coaching a Teachable Student CVPR 2023 CocaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval ACL 2023 CocktailSGD: Fine-tuning Foundation Models over 500Mbps Networks ICML 2023 Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation EMNLP 2023 Collaborative Learning via Prediction Consensus NeurIPS 2023 Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023 Combining Parameter-efficient Modules for Task-level Generalisation EACL 2023 CombLM: Adapting Black-Box Language Models through Small Fine-Tuned Models EMNLP 2023 Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics EMNLP 2023 Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adapter ACL 2023 Complementary Bi-Directional Feature Compression for Indoor 360deg Semantic Segmentation With Self-Distillation WACV 2023 Complete-to-Partial 4D Distillation for Self-Supervised Point Cloud Sequence Representation Learning CVPR 2023 Compressed MoE ASR Model Based on Knowledge Distillation and Quantization Interspeech 2023