← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models ICCV 2025
Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series EMNLP 2025
GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localization ICCV 2025
LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025
EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025
Patch Ranking: Token Pruning as Ranking Prediction for Efficient CLIP WACV 2025
CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation ICCV 2025
Just KIDDIN’ : Knowledge Infusion and Distillation for Detection of INdecent Memes ACL 2025
STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment ACL 2025
3M-Game: Multi-Modal Multi-Task Multi-Teacher Learning for Game Event Detection (Student Abstract) AAAI 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025
In-context Learning Demonstration Generation with Text Distillation IJCAI 2025
LaySummX at BioLaySumm: Retrieval-Augmented Fine-Tuning for Biomedical Lay Summarization Using Abstracts and Retrieved Full-Text Context ACL 2025
Continuous Adverse Weather Removal via Degradation-Aware Distillation CVPR 2025
Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025
CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation CVPR 2025
Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025
Efficient ANN-Guided Distillation: Aligning Rate-based Features of Spiking Neural Networks through Hybrid Block-wise Replacement CVPR 2025
EdTec-ItemGen: Enhancing Retrieval-Augmented Item Generation Through Key Point Extraction ACL 2025
Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025
From Teacher to Student: Tracking Memorization Through Model Distillation ACL 2025
pingan-team at SemEval-2025 Task 2: LoRA-Augmented Qwen2.5 with Wikidata-Driven Entity Translation SEMEVAL 2025
Dianchi at SemEval-2025 Task 11: Multilabel Emotion Recognition via Orthogonal Knowledge Distillation ACL 2025
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging CVPR 2025
MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models EMNLP 2025