Knowledge Distillation

WarriorCoder: Learning from Expert Battles to Augment Code Large Language Models ACL 2025 WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025 Weather Foundation Model Enhanced Decentralized Photovoltaic Power Forecasting Through Spatio-temporal Knowledge Distillation IJCAI 2025 Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers WACV 2025 Weighted Multi-Prompt Learning with Description-free Large Language Model Distillation ICLR 2025 What Makes a Good Dataset for Knowledge Distillation? CVPR 2025 What Makes for Text to 360-degree Panorama Generation with Stable Diffusion? ICCV 2025 What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025 When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs EMNLP 2025 Who Taught You That? Tracing Teachers in Model Distillation ACL 2025 Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025 X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation ICCV 2025 “Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation ACL 2025 Yo'Chameleon: Personalized Vision and Language Generation CVPR 2025 You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025 Your Weak LLM is Secretly a Strong Teacher for Alignment ICLR 2025 Zero-Shot Composed Image Retrieval via Dual-Stream Instruction-Aware Distillation ICCV 2025 Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems COLING 2025 Zero-Shot Vision Encoder Grafting via LLM Surrogates ICCV 2025 zFLoRA: Zero-Latency Fused Low-Rank Adapters EMNLP 2025 ZooProbe: A Data Engine for Evaluating, Exploring, and Evolving Large-scale Training Data for Multimodal LLMs ICLR 2025 Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning NeurIPS 2024 2D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation WACV 2024 3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024 AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation ACL 2024