Knowledge Distillation

DistilPose: Tokenized Pose Regression With Heatmap Distillation CVPR 2023 DistilXLSR: A Light Weight Cross-Lingual Speech Representation Model Interspeech 2023 Domain Generalization via Switch Knowledge Distillation for Robust Review Representation ACL 2023 Efficient RGB-T Tracking via Cross-Modality Distillation CVPR 2023 EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning ACL 2023 EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understanding NeurIPS 2023 Endpoints Weight Fusion for Class Incremental Semantic Segmentation CVPR 2023 End-to-End Zero-Shot HOI Detection via Vision and Language Knowledge Distillation AAAI 2023 Enhanced Multimodal Representation Learning With Cross-Modal KD CVPR 2023 Enhancing Abstractiveness of Summarization Models through Calibrated Distillation EMNLP 2023 Enhancing Conversational Search: Large Language Model-Aided Informative Query Rewriting EMNLP 2023 Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing EMNLP 2023 ERM-KTP: Knowledge-Level Machine Unlearning via Knowledge Transfer CVPR 2023 Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting It into MLPs: An Effective GNN-to-MLP Distillation Framework AAAI 2023 FaLA: Fast Linear Adaptation for Replacing Backbone Models on Edge Devices EMNLP 2023 f-Divergence Minimization for Sequence-Level Knowledge Distillation ACL 2023 Federated Learning with Uncertainty via Distilled Predictive Distributions ACML 2023 Few-Shot Class-Incremental Learning via Class-Aware Bilateral Distillation CVPR 2023 Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training CVPR 2023 Generic-to-Specific Distillation of Masked Autoencoders CVPR 2023 Genie: Show Me the Data for Quantization CVPR 2023 GlobalFlowNet: Video Stabilization Using Deep Distilled Global Motion Estimates WACV 2023 Goal-Conditioned Q-learning as Knowledge Distillation AAAI 2023 Grouped Knowledge Distillation for Deep Face Recognition AAAI 2023 Heterogeneous-Branch Collaborative Learning for Dialogue Generation AAAI 2023