← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

MALTO at SemEval-2025 Task 4: Dual Teachers for Unlearning Sensitive Content in LLMs SEMEVAL 2025
Optimizing Quantized Diffusion Models via Distillation with Cross-Timestep Error Correction AAAI 2025
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025
Dynamic Expansion Diffusion Learning for Lifelong Generative Modelling AAAI 2025
Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025
IQA-Adapter: Exploring Knowledge Transfer from Image Quality Assessment to Diffusion-based Generative Models ICCV 2025
CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination AAAI 2025
Decoupled Distillation to Erase: A General Unlearning Method for Any Class-centric Tasks CVPR 2025
Rethinking Multi-modal Object Detection from the Perspective of Mono-Modality Feature Learning ICCV 2025
Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models ICCV 2025
Adding Additional Control to One-Step Diffusion with Joint Distribution Matching ICCV 2025
DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-trained Video Diffusion Models ICCV 2025
Teaching Sarcasm: Few-Shot Multimodal Sarcasm Detection via Distillation to a Parameter-Efficient Student IJCNLP 2025
Confound from All Sides, Distill with Resilience: Multi-Objective Adversarial Paths to Zero-Shot Robustness ICCV 2025
GARuD: Guided Alignment of Representations using Distillation for Ultra-Low-Resource Languages IJCNLP 2025
Patch Ranking: Token Pruning as Ranking Prediction for Efficient CLIP WACV 2025
Talking Head Anime 4: Distillation for Real-Time Performance WACV 2025
CMAD: Correlation-Aware and Modalities-Aware Distillation for Multimodal Sentiment Analysis with Missing Modalities ICCV 2025
Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025
WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025
Run LoRA Run: Faster and Lighter LoRA Implementations ACL 2025
Depth Any Event Stream: Enhancing Event-based Monocular Depth Estimation via Dense-to-Sparse Distillation ICCV 2025
What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025
Distilling Diffusion Models to Efficient 3D LiDAR Scene Completion ICCV 2025
Task Vector Quantization for Memory-Efficient Model Merging ICCV 2025