Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025 MIND: Math Informed syNthetic Dialogues for Pretraining LLMs ICLR 2025 Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models ICLR 2025 MiniELM: A Lightweight and Adaptive Query Rewriting Framework for E-Commerce Search Optimization ACL 2025 MiniPLM: Knowledge Distillation for Pre-training Language Models ICLR 2025 Mixture of LoRA Experts for Continual Information Extraction with LLMs EMNLP 2025 MKT: A Multi-Stage Knowledge Transfer Framework to Mitigate Catastrophic Forgetting in Multi-Domain Chinese Spelling Correction EMNLP 2025 MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025 M-LLM Based Video Frame Selection for Efficient Video Understanding CVPR 2025 Modal Feature Optimization Network with Prompt for Multimodal Sentiment Analysis COLING 2025 ModalPrompt: Towards Efficient Multimodal Continual Instruction Tuning with Dual-Modality Guided Prompt EMNLP 2025 Model-based Large Language Model Customization as Service EMNLP 2025 Model Calibration for Emotion Detection EMNLP 2025 MODfinity: Unsupervised Domain Adaptation with Multimodal Information Flow Intertwining CVPR 2025 MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation CVPR 2025 Momentum-GS: Momentum Gaussian Self-Distillation for High-Quality Large Scene Reconstruction ICCV 2025 Momentum Posterior Regularization for Multi-hop Dense Retrieval COLING 2025 MonoTAKD: Teaching Assistant Knowledge Distillation for Monocular 3D Object Detection CVPR 2025 Montessori-Instruct: Generate Influential Training Data Tailored for Student Learning ICLR 2025 Moonshine: Distilling Game Content Generators into Steerable Generative Models AAAI 2025 Mosaic-IT: Cost-Free Compositional Data Synthesis for Instruction Tuning ACL 2025 MoSLD: An Extremely Parameter-Efficient Mixture-of-Shared LoRAs for Multi-Task Learning COLING 2025 MOS: Model Surgery for Pre-Trained Model-Based Class-Incremental Learning AAAI 2025 Motal: Unsupervised 3D Object Detection by Modality and Task-specific Knowledge Transfer ICCV 2025 MoVE-KD: Knowledge Distillation for VLMs with Mixture of Visual Encoders CVPR 2025