Knowledge Distillation

Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis ACL 2025 Beyond the Mode: Sequence-Level Distillation of Multilingual Translation Models for Low-Resource Language Pairs NAACL 2025 BiLD: Bi-directional Logits Difference Loss for Large Language Model Distillation COLING 2025 BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions CVPR 2025 BOND: Aligning LLMs with Best-of-N Distillation ICLR 2025 Boosting the Capabilities of Compact Models in Low-Data Contexts with Large Language Models and Retrieval-Augmented Generation COLING 2025 Both Supply and Precision: Sample Debias and Ranking Consistency Joint Learning for Large Scale Pre-Ranking System AAAI 2025 Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream Knowledge EMNLP 2025 Bridging Information Gaps with Comprehensive Answers: Improving the Diversity and Informativeness of Follow-Up Questions EMNLP 2025 Bridging Relevance and Reasoning: Rationale Distillation in Retrieval-Augmented Generation ACL 2025 Bridging the Gap: Efficient Cross-Lingual NER in Low-Resource Financial Domain COLING 2025 Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud COLING 2025 Building Resource-Constrained Language Agents: A Korean Case Study on Chemical Toxicity Information EMNLP 2025 C2KD: Cross-layer and Cross-head Knowledge Distillation for Small Language Model-based Recommendation ACL 2025 Cached Multi-Lora Composition for Multi-Concept Image Generation ICLR 2025 Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? ACL 2025 Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs EMNLP 2025 Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025 Can’t Hide Behind the API: Stealing Black-Box Commercial Embedding Models NAACL 2025 cAST: Enhancing Code Retrieval-Augmented Generation with Structural Chunking via Abstract Syntax Tree EMNLP 2025 Causal Inference with Large Language Model: A Survey NAACL 2025 CD^2: Constrained Dataset Distillation for Few-Shot Class-Incremental Learning IJCAI 2025 CEMIL: Contextual Attention Based Efficient Weakly Supervised Approach for Histopathology Image Classification WACV 2025 Chain-of-Specificity: Enhancing Task-Specific Constraint Adherence in Large Language Models COLING 2025 Chimera: Improving Generalist Model with Domain-Specific Experts ICCV 2025