Knowledge Distillation

Boot and Switch: Alternating Distillation for Zero-Shot Dense Retrieval EMNLP 2023 Bridging the Gap between Decision and Logits in Decision-based Knowledge Distillation for Pre-trained Language Models ACL 2023 Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models EMNLP 2023 Can Bad Teaching Induce Forgetting? Unlearning in Deep Networks Using an Incompetent Teacher AAAI 2023 Can We Edit Factual Knowledge by In-Context Learning? EMNLP 2023 Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models? ICML 2023 CaPriDe Learning: Confidential and Private Decentralized Learning Based on Encryption-Friendly Distillation Loss CVPR 2023 Class Attention Transfer Based Knowledge Distillation CVPR 2023 CLIPPING: Distilling CLIP-Based Models With a Student Base for Video-Language Retrieval CVPR 2023 CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation NeurIPS 2023 Cluster-aware Semi-supervised Learning: Relational Knowledge Distillation Provably Learns Clustering NeurIPS 2023 Coaching a Teachable Student CVPR 2023 CoLaDa: A Collaborative Label Denoising Framework for Cross-lingual Named Entity Recognition ACL 2023 Compressed MoE ASR Model Based on Knowledge Distillation and Quantization Interspeech 2023 Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023 Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation ACL 2023 Consistency is Key: On Data-Efficient Modality Transfer in Speech Translation EMNLP 2023 Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023 Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining ICML 2023 Cost-effective Distillation of Large Language Models ACL 2023 Co-Training 2L Submodels for Visual Recognition CVPR 2023 Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023 CR-FIQA: Face Image Quality Assessment by Learning Sample Relative Classifiability CVPR 2023 Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages ACL 2023 Cross-Modal Distillation for Speaker Recognition AAAI 2023