← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

DAM: Dynamic Adapter Merging for Continual Video QA Learning WACV 2025
Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation CVPR 2025
LED-Merging: Mitigating Safety-Utility Conflicts in Model Merging with Location-Election-Disjoint ACL 2025
Curriculum Hierarchical Knowledge Distillation for Bias-Free Survival Prediction IJCAI 2025
Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting ICCV 2025
LUT-Fuse: Towards Extremely Fast Infrared and Visible Image Fusion via Distillation to Learnable Look-Up Tables ICCV 2025
Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025
What Makes a Good Dataset for Knowledge Distillation? CVPR 2025
Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance AAAI 2025
Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025
Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025
Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks CVPR 2025
Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025
Scaling Down Text Encoders of Text-to-Image Diffusion Models CVPR 2025
Investigating the Transferability of Code Repair for Low-Resource Programming Languages NAACL 2025
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments ACL 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
Vicomtech@WMT 2025: Evolutionary Model Compression for Machine Translation EMNLP 2025
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework NAACL 2025
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment CVPR 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning ACL 2025
OGP-Net: Optical Guidance Meets Pixel-Level Contrastive Distillation for Robust Multi-Modal and Missing Modality Segmentation AAAI 2025