student model

Knowledge Distillation for Learned Image Compression ICCV 2025 Knowledge Distillation with Refined Logits ICCV 2025 Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025 MiniPLM: Knowledge Distillation for Pre-training Language Models ICLR 2025 Quantifying Knowledge Distillation using Partial Information Decomposition AISTATS 2025 Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025 Right Time to Learn: Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation ICML 2025 RTSM: Knowledge Distillation with Diverse Signals for Efficient Real-Time Semantic Matching in E-Commerce NAACL 2025 Single Teacher, Multiple Perspectives: Teacher Knowledge Augmentation for Enhanced Knowledge Distillation ICLR 2025 SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025 Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales EMNLP 2025 Towards the Law of Capacity Gap in Distilling Language Models ACL 2025 What Makes a Good Dataset for Knowledge Distillation? CVPR 2025 What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025 Accurate Knowledge Distillation via n-best Reranking NAACL 2024 Adversarial Moment-Matching Distillation of Large Language Models NeurIPS 2024 Cache & Distil: Optimising API Calls to Large Language Models ACL 2024 CorrSynth - A Correlated Sampling Method for Diverse Dataset Generation from LLMs EMNLP 2024 DFD: Distilling the Feature Disparity Differently for Detectors ICML 2024 Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning EMNLP 2024 Enhancing Class-Imbalanced Learning with Pre-Trained Guidance through Class-Conditional Knowledge Distillation ICML 2024 Evolving Knowledge Distillation with Large Language Models and Active Learning COLING 2024 FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation EMNLP 2024 FreeKD: Knowledge Distillation via Semantic Frequency Prompt CVPR 2024 Frequency Attention for Knowledge Distillation WACV 2024