Knowledge Distillation

Efficient RGB-T Tracking via Cross-Modality Distillation CVPR 2023 Efficient Training of Large-Scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout AAAI 2023 Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023 EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023 EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NeurIPS 2023 EM-Network: Oracle Guided Self-distillation for Sequence Learning ICML 2023 Enabling Classifiers to Make Judgements Explicitly Aligned with Human Values ACL 2023 End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation AAAI 2023 Enhanced Multimodal Representation Learning With Cross-Modal KD CVPR 2023 Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023 Enhancing Adversarial Robustness in Low-Label Regime via Adaptively Weighted Regularization and Knowledge Distillation ICCV 2023 Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023 Evaluating Parameter-Efficient Finetuning Approaches for Pre-trained Models on the Financial Domain EMNLP 2023 Evaluating the Knowledge Base Completion Potential of GPT EMNLP 2023 Event Causality Extraction via Implicit Cause-Effect Interactions EMNLP 2023 Exploiting Unlabelled Photos for Stronger Fine-Grained SBIR CVPR 2023 Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023 Exploring Open-Vocabulary Semantic Segmentation from CLIP Vision Encoder Distillation Only ICCV 2023 Exploring the Impact of Model Scaling on Parameter-Efficient Tuning EMNLP 2023 Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023 Fair Graph Distillation NeurIPS 2023 FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection WACV 2023 f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023 FeatureNeRF: Learning Generalizable NeRFs by Distilling Foundation Models ICCV 2023 FedFed: Feature Distillation against Data Heterogeneity in Federated Learning NeurIPS 2023