Knowledge Distillation

Distilling Long-tailed Datasets CVPR 2025 Distilling Many-Shot In-Context Learning into a Cheat Sheet EMNLP 2025 Distilling Monocular Foundation Model for Fine-grained Depth Completion CVPR 2025 Distilling Multi-modal Large Language Models for Autonomous Driving CVPR 2025 Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models ICCV 2025 Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025 Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentation CVPR 2025 Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025 Distill Visual Chart Reasoning Ability from LLMs to MLLMs EMNLP 2025 DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models ACL 2025 Distribution Backtracking Builds A Faster Convergence Trajectory for Diffusion Distillation ICLR 2025 Diversity-Rewarded CFG Distillation ICLR 2025 DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025 DL-KDD: Dual-Lightness Knowledge Distillation for Action Recognition in the Dark IJCAI 2025 DLRG at BHASHA: Task 1 (IndicGEC): A Hybrid Neurosymbolic Approach for Tamil and Malayalam Grammatical Error Correction AACL 2025 DM-Codec: Distilling Multimodal Representations for Speech Tokenization EMNLP 2025 Dobi-SVD: Differentiable SVD for LLM Compression and Some New Perspectives ICLR 2025 DoDS-IITPKD:Submissions to the WMT25 Low-Resource Indic Language Translation Task EMNLP 2025 Does Rationale Quality Matter? Enhancing Mental Disorder Detection via Selective Reasoning Distillation ACL 2025 DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025 Domain Guidance: A Simple Transfer Approach for a Pre-trained Diffusion Model ICLR 2025 DoMIX: An Efficient Framework for Exploiting Domain Knowledge in Fine-Tuning ACL 2025 Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning ACL 2025 DPED: Multi-Layer Noise Distillation for Privacy-Preserving Text Embeddings EMNLP 2025 DPMamba: Distillation Prompt Mamba for Multimodal Remote Sensing Image Classification with Missing Modalities IJCAI 2025