Knowledge Distillation

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025 MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning NAACL 2025 MimicGait: A Model Agnostic Approach for Occluded Gait Recognition using Correlational Knowledge Distillation WACV 2025 MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025 MiniELM: A Lightweight and Adaptive Query Rewriting Framework for E-Commerce Search Optimization ACL 2025 Minimal Interaction Seperated Tuning: A New Paradigm for Visual Adaptation CVPR 2025 Mining your own secrets: Diffusion Classifier Scores for Continual Personalization of Text-to-Image Diffusion Models ICLR 2025 Mixture of Knowledge Minigraph Agents for Literature Review Generation AAAI 2025 MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025 Modal Feature Optimization Network with Prompt for Multimodal Sentiment Analysis COLING 2025 Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models ACL 2025 Model Calibration for Emotion Detection EMNLP 2025 Model merging with SVD to tie the Knots ICLR 2025 MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation CVPR 2025 Momentum Posterior Regularization for Multi-hop Dense Retrieval COLING 2025 MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detection CVPR 2025 Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning ICLR 2025 Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning ACL 2025 Motal: Unsupervised 3D Object Detection by Modality and Task-specific Knowledge Transfer ICCV 2025 MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders CVPR 2025 MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation NAACL 2025 MS-RAG: Simple and Effective Multi-Semantic Retrieval-Augmented Generation EMNLP 2025 MTVHunter: Smart Contracts Vulnerability Detection Based on Multi-Teacher Knowledge Translation AAAI 2025 Multi-label Self Knowledge Distillation AAAI 2025 Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets WACV 2025