Knowledge Distillation

Speculative RAG: Enhancing Retrieval Augmented Generation through Drafting ICLR 2025 Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025 SSVQ: Unleashing the Potential of Vector Quantization with Sign-Splitting ICCV 2025 Stable Mean Teacher for Semi-supervised Video Action Detection AAAI 2025 Stacked LoRA: Isolated Low-Rank Adaptation for Lifelong Knowledge Management IJCNLP 2025 Staged Knowledge Distillation Through Least-to-Most Prompting: Optimizing Teacher Guidance via Difficulty-Aware Training EMNLP 2025 STAIR-AIG: Optimizing the Automated Item Generation Process through Human-AI Collaboration for Critical Thinking Assessment ACL 2025 Static Word Embeddings for Sentence Semantic Representation EMNLP 2025 StepER: Step-wise Knowledge Distillation for Enhancing Reasoning Ability in Multi-Step Retrieval-Augmented Language Models EMNLP 2025 Streamlining LLMs: Adaptive Knowledge Distillation for Tailored Language Models NAACL 2025 Stronger Models are Not Always Stronger Teachers for Instruction Tuning NAACL 2025 Structured Moral Reasoning in Language Models: A Value-Grounded Evaluation Framework EMNLP 2025 STRUX: An LLM for Decision-Making with Structured Explanations NAACL 2025 Suit the Node Pair to the Case: A Multi-Scale Node Pair Grouping Strategy for Graph-MLP Distillation IJCAI 2025 SwiftKV: Fast Prefill-Optimized Inference with Knowledge-Preserving Model Transformation EMNLP 2025 Swiss Army Knife: Synergizing Biases in Knowledge from Vision Foundation Models for Multi-Task Learning ICLR 2025 SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025 Synergistic Weak-Strong Collaboration by Aligning Preferences ACL 2025 Synergizing Multimodal Temporal Knowledge Graphs and Large Language Models for Social Relation Recognition EMNLP 2025 SyntheT2C: Generating Synthetic Data for Fine-Tuning Large Language Models on the Text2Cypher Task COLING 2025 Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025 Syntriever: How to Train Your Retriever with Synthetic Data from LLMs NAACL 2025 T2V-Turbo-v2: Enhancing Video Model Post-Training through Data, Reward, and Conditional Guidance Design ICLR 2025 Table-R1: Inference-Time Scaling for Table Reasoning Tasks EMNLP 2025 Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025