Knowledge Distillation

Learning Unified Distance Metric Across Diverse Data Distributions with Parameter-Efficient Transfer Learning WACV 2025 Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025 LED-Merging: Mitigating Safety-Utility Conflicts in Model Merging with Location-Election-Disjoint ACL 2025 Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model ICLR 2025 Leveraging Large Language Models for Active Merchant Non-player Characters IJCAI 2025 Leveraging Text-to-Text Transformers as Classifier Chain for Few-Shot Multi-Label Classification EMNLP 2025 LightBSR: Towards Lightweight Blind Super-Resolution via Discriminative Implicit Degradation Representation Learning ICCV 2025 Lightweight Contrastive Distilled Hashing for Online Cross-modal Retrieval AAAI 2025 LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging ICLR 2025 LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMs ACL 2025 LLaVA-KD: A Framework of Distilling Multimodal Large Language Models ICCV 2025 LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation ICLR 2025 LLM4RSR: Large Language Models as Data Correctors for Robust Sequential Recommendation AAAI 2025 LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025 LLM-Based Web Data Collection for Research Dataset Creation EMNLP 2025 LLM Braces: Straightening Out LLM Predictions with Relevant Sub-Updates ACL 2025 LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering EMNLP 2025 LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025 Local Dense Logit Relations for Enhanced Knowledge Distillation ICCV 2025 LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning ICLR 2025 Logic Distillation: Learning from Code Function by Function for Decision-making Tasks IJCAI 2025 Logits-Based Finetuning EMNLP 2025 Logit Space Constrained Fine-Tuning for Mitigating Hallucinations in LLM-Based Recommender Systems EMNLP 2025 LOHRec: Leveraging Order and Hierarchy in Generative Sequential Recommendation EMNLP 2025 LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025