← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025
Inference-Time Diffusion Model Distillation ICCV 2025
CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation ICCV 2025
STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment ACL 2025
Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025
LaySummX at BioLaySumm: Retrieval-Augmented Fine-Tuning for Biomedical Lay Summarization Using Abstracts and Retrieved Full-Text Context ACL 2025
Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025
Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025
HFD-Teacher: High-Frequency Depth Distillation from Depth Foundation Models for Enhanced Depth Completion ICCV 2025
Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025
Dianchi at SemEval-2025 Task 11: Multilabel Emotion Recognition via Orthogonal Knowledge Distillation ACL 2025
Howard University-AI4PC at SemEval-2025 Task 4: Unlearning Sensitive Content From Large Language Models Using Finetuning and Distillation for Selective Knowledge Removal ACL 2025
Balancing Invariant and Specific Knowledge for Domain Generalization with Online Knowledge Distillation IJCAI 2025
QM-AI at SemEval-2025 Task 6: an Ensemble of BERT Models for Promise Identification in ESG Context ACL 2025
Local Dense Logit Relations for Enhanced Knowledge Distillation ICCV 2025
DNB-AI-Project at SemEval-2025 Task 5: An LLM-Ensemble Approach for Automated Subject Indexing ACL 2025
Leveraging Large Language Models for Active Merchant Non-player Characters IJCAI 2025
GCD: Advancing Vision-Language Models for Incremental Object Detection via Global Alignment and Correspondence Distillation AAAI 2025
What Makes a Good Dataset for Knowledge Distillation? CVPR 2025
Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025
GE-Chat: A Graph Enhanced RAG Framework for Evidential Response Generation of LLMs IJCAI 2025
KDAT: Inherent Adversarial Robustness via Knowledge Distillation with Adversarial Tuning for Object Detection Models AAAI 2025
WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025
Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval AAAI 2025
CIARD: Cyclic Iterative Adversarial Robustness Distillation ICCV 2025