Knowledge Distillation

Neural Collapse Inspired Knowledge Distillation AAAI 2025 Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025 Neural Parameter Search for Slimmer Fine-Tuned Models and Better Transfer ACL 2025 OAC: Output-adaptive Calibration for Accurate Post-training Quantization AAAI 2025 OGP-Net: Optical Guidance Meets Pixel-Level Contrastive Distillation for Robust Multi-Modal and Missing Modality Segmentation AAAI 2025 On Collaborating Small and Large Models For Few-shot Intent Detection EMNLP 2025 One for All: Update Parameterized Knowledge Across Multiple Models with Once Edit ACL 2025 One-Way Ticket: Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion Models CVPR 2025 On Local Overfitting and Forgetting in Deep Neural Networks AAAI 2025 On the Within-class Variation Issue in Alzheimer's Disease Detection Interspeech 2025 Optimize Incompatible Parameters Through Compatibility-aware Knowledge Integration AAAI 2025 Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation EMNLP 2025 Parameter-Aware Contrastive Knowledge Editing: Tracing and Rectifying based on Critical Transmission Paths ACL 2025 PartField: Learning 3D Feature Fields for Part Segmentation and Beyond ICCV 2025 Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025 PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning ACL 2025 POSITION BIAS MITIGATES POSITION BIAS: Mitigate Position Bias Through Inter-Position Knowledge Distillation EMNLP 2025 Pre-training Distillation for Large Language Models: A Design Space Exploration ACL 2025 Prevalence of Negative Transfer in Continual Reinforcement Learning: Analyses and a Simple Baseline ICLR 2025 Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data CVPR 2025 Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation ACL 2025 ProReason: Multi-Modal Proactive Reasoning with Decoupled Eyesight and Wisdom EMNLP 2025 PruneSLU: Efficient On-device Spoken Language Understanding through Vocabulary and Structural Pruning Interspeech 2025 Pruning Large Language Models with Semi-Structural Adaptive Sparse Training AAAI 2025 Punching Above Precision: Small Quantized Model Distillation with Learnable Regularizer ACML 2025