knowledge distillation

When Big Models Train Small Ones: Label-Free Model Parity Alignment for Efficient Visual Question Answering using Small VLMs EMNLP 2025 When Data-Free Knowledge Distillation Meets Non-Transferable Teacher: Escaping Out-of-Distribution Trap is All You Need ICML 2025 When Inverse Data Outperforms: Exploring the Pitfalls of Mixed Data in Multi-Stage Fine-Tuning EMNLP 2025 When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models EMNLP 2025 Who Taught You That? Tracing Teachers in Model Distillation ACL 2025 Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025 Word Level Timestamp Generation for Automatic Speech Recognition and Translation Interspeech 2025 X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation ICCV 2025 “Yes, My LoRD.” Guiding Language Model Extraction with Locality Reinforced Distillation ACL 2025 You are an LLM teaching a smaller model everything you know: Multi-task pretraining of language models with LLM-designed study plans EMNLP 2025 You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025 Your Weak LLM is Secretly a Strong Teacher for Alignment ICLR 2025 Zero-Shot Composed Image Retrieval via Dual-Stream Instruction-Aware Distillation ICCV 2025 Zero-shot Federated Unlearning via Transforming from Data-Dependent to Personalized Model-Centric IJCAI 2025 Zero-shot Slot Filling in the Age of LLMs for Dialogue Systems COLING 2025 Zero-Shot Vision Encoder Grafting via LLM Surrogates ICCV 2025 2D Feature Distillation for Weakly- and Semi-Supervised 3D Semantic Segmentation WACV 2024 2DQuant: Low-bit Post-Training Quantization for Image Super-Resolution NeurIPS 2024 3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024 Accurate Forgetting for Heterogeneous Federated Continual Learning ICLR 2024 Accurate Knowledge Distillation via n-best Reranking NAACL 2024 Active Object Detection with Knowledge Aggregation and Distillation from Large Models CVPR 2024 ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024 AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models EMNLP 2024 Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-Free Continual Learning WACV 2024