Knowledge Distillation

VRM: Knowledge Distillation via Virtual Relation Matching ICCV 2025 WAVE: Weight Templates for Adaptive Initialization of Variable-sized Models CVPR 2025 What Makes a Good Dataset for Knowledge Distillation? CVPR 2025 What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025 When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs EMNLP 2025 Who Taught You That? Tracing Teachers in Model Distillation ACL 2025 Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025 Word Level Timestamp Generation for Automatic Speech Recognition and Translation Interspeech 2025 “Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation ACL 2025 You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025 Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems COLING 2025 Trans-LoRA: towards data-free Transferable Parameter Efficient Finetuning NeurIPS 2024 Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild NeurIPS 2024 Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024 ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024 Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024 Advancing Large Language Model Attribution through Self-Improving EMNLP 2024 Advancing Vision-Language Models with Adapter Ensemble Strategies EMNLP 2024 Adversarial Distillation Based on Slack Matching and Attribution Region Alignment CVPR 2024 A Dynamic GCN with Cross-Representation Distillation for Event-Based Learning AAAI 2024 A Kernel Perspective on Distillation-based Collaborative Learning NeurIPS 2024 AlignCap: Aligning Speech Emotion Captioning to Human Preferences EMNLP 2024 Aligning Logits Generatively for Principled Black-Box Knowledge Distillation CVPR 2024 All but One: Surgical Concept Erasing with Model Preservation in Text-to-Image Diffusion Models AAAI 2024 AmoebaLLM: Constructing Any-Shape Large Language Models for Efficient and Instant Deployment NeurIPS 2024