Knowledge Distillation

Masking meets Supervision: A Strong Learning Alliance CVPR 2025 MaTVLM: Hybrid Mamba-Transformer for Efficient Vision-Language Modeling ICCV 2025 Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025 Membership and Memorization in LLM Knowledge Distillation EMNLP 2025 Memorization Inheritance in Sequence-Level Knowledge Distillation for Neural Machine Translation ACL 2025 Memorizing is Not Enough: Deep Knowledge Injection Through Reasoning ACL 2025 MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities AAAI 2025 MicroEdit: Neuron-level Knowledge Disentanglement and Localization in Lifelong Model Editing EMNLP 2025 MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025 MimicGait: A Model Agnostic Approach for Occluded Gait Recognition using Correlational Knowledge Distillation WACV 2025 MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025 MKD: Multi-Knowledge Distillation for Real-Time Object Detection on Edge Devices ACML 2025 M-LLM Based Video Frame Selection for Efficient Video Understanding CVPR 2025 Momentum-GS: Momentum Gaussian Self-Distillation for High-Quality Large Scene Reconstruction ICCV 2025 Moonshine: Distilling Game Content Generators into Steerable Generative Models AAAI 2025 MOS: Model Surgery for Pre-Trained Model-Based Class-Incremental Learning AAAI 2025 Multi-Granularity Class Prototype Topology Distillation for Class-Incremental Source-Free Unsupervised Domain Adaptation CVPR 2025 Multi-label Self Knowledge Distillation AAAI 2025 Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets WACV 2025 Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models AAAI 2025 Multilingual Continual Learning using Attention Distillation COLING 2025 Multimodal Commonsense Knowledge Distillation for Visual Question Answering (Student Abstract) AAAI 2025 Multi-modal Knowledge Distillation-based Human Trajectory Forecasting CVPR 2025 Multistage Universal Speech Enhancement System for URGENT Challenge Interspeech 2025 Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition AAAI 2025