Knowledge Distillation

Condensing Multilingual Knowledge with Lightweight Language-Specific Modules EMNLP 2023 Conditional Adapters: Parameter-efficient Transfer Learning with Fast Inference NeurIPS 2023 Conformer-based Language Embedding with Self-Knowledge Distillation for Spoken Language Identification Interspeech 2023 ConKI: Contrastive Knowledge Injection for Multimodal Sentiment Analysis ACL 2023 Connective Prediction for Implicit Discourse Relation Recognition via Knowledge Distillation ACL 2023 Consistency is Key: On Data-Efficient Modality Transfer in Speech Translation EMNLP 2023 Constructing Deep Spiking Neural Networks From Artificial Neural Networks With Knowledge Distillation CVPR 2023 Continual Knowledge Distillation for Neural Machine Translation ACL 2023 Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023 Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretraining ICML 2023 Copyright-Certified Distillation Dataset: Distilling One Million Coins into One Bitcoin with Your Private Key AAAI 2023 Cost-effective Distillation of Large Language Models ACL 2023 Co-Training 2L Submodels for Visual Recognition CVPR 2023 Co-training and Co-distillation for Quality Improvement and Compression of Language Models EMNLP 2023 CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model EMNLP 2023 Cross-Level Distillation and Feature Denoising for Cross-Domain Few-Shot Classification ICLR 2023 Cross-Lingual Cross-Target Stance Detection with Dual Knowledge Distillation Framework EMNLP 2023 Cross-Lingual Knowledge Distillation for Answer Sentence Selection in Low-Resource Languages ACL 2023 Cross-Modal Distillation for Speaker Recognition AAAI 2023 CRUSH4SQL: Collective Retrieval Using Schema Hallucination For Text2SQL EMNLP 2023 CrysGNN: Distilling Pre-trained Knowledge to Enhance Property Prediction for Crystalline Materials AAAI 2023 Cumulative Spatial Knowledge Distillation for Vision Transformers ICCV 2023 CUNI at WMT23 General Translation Task: MT and a Genetic Algorithm EMNLP 2023 CUPID: Curriculum Learning Based Real-Time Prediction using Distillation ACL 2023 Curriculum Temperature for Knowledge Distillation AAAI 2023