Knowledge Distillation

COMBHelper: A Neural Approach to Reduce Search Space for Graph Combinatorial Problems AAAI 2024 Compact Language Models via Pruning and Knowledge Distillation NeurIPS 2024 Complementary Knowledge Distillation for Robust and Privacy-Preserving Model Serving in Vertical Federated Learning AAAI 2024 Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold AAAI 2024 Contextual Affinity Distillation for Image Anomaly Detection WACV 2024 Correlation-Decoupled Knowledge Distillation for Multimodal Sentiment Analysis with Incomplete Modalities CVPR 2024 CrossKD: Cross-Head Knowledge Distillation for Object Detection CVPR 2024 Cross-modal Representation Flattening for Multi-modal Domain Generalization NeurIPS 2024 D2LLM: Decomposed and Distilled Large Language Models for Semantic Search ACL 2024 D3T: Distinctive Dual-Domain Teacher Zigzagging Across RGB-Thermal Gap for Domain-Adaptive Object Detection CVPR 2024 DAdEE: Unsupervised Domain Adaptation in Early Exit PLMs EMNLP 2024 DAFNet: Dynamic Auxiliary Fusion for Sequential Model Editing in Large Language Models ACL 2024 Data Distribution Distilled Generative Model for Generalized Zero-Shot Recognition AAAI 2024 Data-Free Quantization via Pseudo-label Filtering CVPR 2024 De-confounded Data-free Knowledge Distillation for Handling Distribution Shifts CVPR 2024 Decoupled Kullback-Leibler Divergence Loss NeurIPS 2024 DeiT-LT: Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasets CVPR 2024 DEM: Distribution Edited Model for Training with Mixed Data Distributions EMNLP 2024 DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion NeurIPS 2024 DiffMorpher: Unleashing the Capability of Diffusion Models for Image Morphing CVPR 2024 DIOD: Self-Distillation Meets Object Discovery CVPR 2024 Direct May Not Be the Best: An Incremental Evolution View of Pose Generation AAAI 2024 Dirichlet Continual Learning: Tackling Catastrophic Forgetting in NLP UAI 2024 Distillation Enhanced Generative Retrieval ACL 2024 Distilling Autoregressive Models to Obtain High-Performance Non-autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed AAAI 2024