← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

A Fast Neural Architecture Search Method for Multi-Modal Classification via Knowledge Sharing IJCAI 2025
Soft Separation and Distillation: Toward Global Uniformity in Federated Unsupervised Learning ICCV 2025
Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025
From Crafting Text to Crafting Thought: Grounding Intelligent Writing Support to Writing Center Pedagogy NAACL 2025
Efficient Ensemble for Fine-tuning Language Models on Multiple Datasets ACL 2025
DataHacks at PerAnsSumm 2025: LoRA-Driven Prompt Engineering for Perspective Aware Span Identification and Summarization NAACL 2025
MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025
Don’t Half-listen: Capturing Key-part Information in Continual Instruction Tuning ACL 2025
A Cross-Modal Densely Guided Knowledge Distillation Based on Modality Rebalancing Strategy for Enhanced Unimodal Emotion Recognition IJCAI 2025
FMD: Comprehensive Data Compression in Medical Domain via Fused Matching Distillation WACV 2025
Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025
Improving Pre-trained Language Models with Knowledge Enhancement and Filtering Framework NAACL 2025
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation ACL 2025
SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025
Investigating the Transferability of Code Repair for Low-Resource Programming Languages NAACL 2025
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments ACL 2025
Suit the Node Pair to the Case: A Multi-Scale Node Pair Grouping Strategy for Graph-MLP Distillation IJCAI 2025
Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation CVPR 2025
IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization ACL 2025
TeEFusion: Blending Text Embeddings to Distill Classifier-Free Guidance ICCV 2025
Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025
Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025
A Knowledge Distillation-Based Approach to Enhance Transparency of Classifier Models AAAI 2025
Multi-Surrogate-Teacher Assistance for Representation Alignment in Fingerprint-Based Indoor Localization WACV 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025