Knowledge Distillation

PrAd: Prompt Adaptive Tuning for Decoder-only Language Models EMNLP 2025 Precise Parameter Localization for Textual Generation in Diffusion Models ICLR 2025 Presto! Distilling Steps and Layers for Accelerating Music Generation ICLR 2025 Pre-training Distillation for Large Language Models: A Design Space Exploration ACL 2025 Pretraining Language Models with LoRA and Artificial Languages EMNLP 2025 Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos AAAI 2025 Process-Supervised Reinforcement Learning for Code Generation EMNLP 2025 Progressive distillation induces an implicit curriculum ICLR 2025 Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data CVPR 2025 ProMALex: Progressive Modular Adapters for Multi-Jurisdictional Legal Language Modeling ACL 2025 Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation ACL 2025 PromptDet: A Lightweight 3D Object Detection Framework with LiDAR Prompts AAAI 2025 PromptOptMe: Error-Aware Prompt Compression for LLM-based MT Evaluation Metrics NAACL 2025 Prototypical Replay with Old-class Focusing Knowledge Distillation for Incremental Named Entity Recognition AAAI 2025 Proxy Denoising for Source-Free Domain Adaptation ICLR 2025 Pruning Large Language Models with Semi-Structural Adaptive Sparse Training AAAI 2025 PseDet: Revisiting the Power of Pseudo Label in Incremental Object Detection ICLR 2025 QCRD: Quality-guided Contrastive Rationale Distillation for Large Language Models EMNLP 2025 Quantification of Large Language Model Distillation ACL 2025 Quantized Can Still Be Calibrated: A Unified Framework to Calibration in Quantized Large Language Models ACL 2025 Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models EMNLP 2025 R²-CoD: Understanding Text-Graph Complementarity in Relational Reasoning via Knowledge Co-Distillation IJCNLP 2025 RADIOv2.5: Improved Baselines for Agglomerative Vision Foundation Models CVPR 2025 RAG+: Enhancing Retrieval-Augmented Generation with Application-Aware Reasoning EMNLP 2025 RAGG: Retrieval-Augmented Grasp Generation Model AAAI 2025