← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks CVPR 2025
Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025
Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025
Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025
RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning EMNLP 2025
When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs EMNLP 2025
EgoLife: Towards Egocentric Life Assistant CVPR 2025
OGP-Net: Optical Guidance Meets Pixel-Level Contrastive Distillation for Robust Multi-Modal and Missing Modality Segmentation AAAI 2025
Yo'Chameleon: Personalized Vision and Language Generation CVPR 2025
BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions CVPR 2025
LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning ICCV 2025
Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models ACL 2025
Dual-Process Image Generation ICCV 2025
ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses AACL 2025
Adaptive Collaborative Labeling with MLLMs for Low-Resource Multimodal Emotion Recognition AACL 2025
DiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval CVPR 2025
Quantized Can Still Be Calibrated: A Unified Framework to Calibration in Quantized Large Language Models ACL 2025
ResidualViT for Efficient Temporally Dense Video Encoding ICCV 2025
You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025
Basic Reading Distillation ACL 2025
Single-Layer Distillation with Fourier Convolutions for Texture Anomaly Detection WACV 2025
Minimal Interaction Seperated Tuning: A New Paradigm for Visual Adaptation CVPR 2025
A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality EMNLP 2025
PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free ACL 2025
Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025