Knowledge Distillation

Expanding Expressiveness of Diffusion Models With Limited Data via Self-Distillation Based Fine-Tuning WACV 2024 Expediting Contrastive Language-Image Pretraining via Self-Distilled Encoders AAAI 2024 Exploring Domain Robust Lightweight Reward Models based on Router Mechanism ACL 2024 Exploring Efficient Asymmetric Blind-Spots for Self-Supervised Denoising in Real-World Scenarios CVPR 2024 Exploring Learngene via Stage-wise Weight Sharing for Initializing Variable-sized Models IJCAI 2024 FAKD: Feature Augmented Knowledge Distillation for Semantic Segmentation WACV 2024 Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper EMNLP 2024 FD3D: Exploiting Foreground Depth Map for Feature-Supervised Monocular 3D Object Detection AAAI 2024 Federated Learning with Extremely Noisy Clients via Negative Distillation AAAI 2024 Federated Model Heterogeneous Matryoshka Representation Learning NeurIPS 2024 FedLTF: Linear Probing Teaches Fine-tuning to Mitigate Noisy Labels in Federated Learning ACML 2024 Find the Lady: Permutation and Re-synchronization of Deep Neural Networks AAAI 2024 FineCLIP: Self-distilled Region-based CLIP for Better Fine-grained Understanding NeurIPS 2024 FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024 FREE: Faster and Better Data-Free Meta-Learning CVPR 2024 FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024 From Instance Training to Instruction Learning: Task Adapters Generation from Instructions NeurIPS 2024 Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching CVPR 2024 Generative Model-Based Feature Knowledge Distillation for Action Recognition AAAI 2024 GoodSAM: Bridging Domain and Capacity Gaps via Segment Anything Model for Distortion-aware Panoramic Semantic Segmentation CVPR 2024 GOVERN: Gradient Orientation Vote Ensemble for Multi-Teacher Reinforced Distillation EMNLP 2024 GuardEmb: Dynamic Watermark for Safeguarding Large Language Model Embedding Service Against Model Stealing Attack EMNLP 2024 Hear You Say You: An Efficient Framework for Marine Mammal Sounds’ Classification AAAI 2024 Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models EMNLP 2024 Holistic Features are almost Sufficient for Text-to-Video Retrieval CVPR 2024