Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

The Gemma Sutras: Fine-Tuning Gemma 3 for Sanskrit Sandhi Splitting EMNLP 2025 The Green KNIGHT: Green Machine Translation with Knowledge-Distilled, Narrow, Inexpensive, Greedy, Hybrid Transformers EMNLP 2025 The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding? ACL 2025 ThinkAnswer Loss: Balancing Semantic Similarity and Exact Matching for LLM Reasoning Enhancement EMNLP 2025 Thinking with DistilQwen: A Tale of Four Distilled Reasoning and Reward Model Series EMNLP 2025 ThinkSLM: Towards Reasoning in Small Language Models EMNLP 2025 TinySAM: Pushing the Envelope for Efficient Segment Anything Model AAAI 2025 TinyThinker: Distilling Reasoning through Coarse-to-Fine Knowledge Internalization with Self-Reflection NAACL 2025 ToDi: Token-wise Distillation via Fine-Grained Divergence Control EMNLP 2025 ToVE: Efficient Vision-Language Learning via Knowledge Transfer from Vision Experts ICLR 2025 Toward Data-centric Directed Graph Learning: An Entropy-driven Approach ICML 2025 Toward Efficient Data-Free Unlearning AAAI 2025 Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generation ACL 2025 Towards Efficient CoT Distillation: Self-Guided Rationale Selector for Better Performance with Fewer Rationales EMNLP 2025 Towards Event Extraction with Massive Types: LLM-based Collaborative Annotation and Partitioning Extraction EMNLP 2025 Towards Faithful Multi-step Reasoning through Fine-Grained Causal-aware Attribution Reasoning Distillation COLING 2025 Towards Fast, Specialized Machine Learning Force Fields: Distilling Foundation Models via Energy Hessians ICLR 2025 Towards General-Domain Word Sense Disambiguation: Distilling Large Language Model into Compact Disambiguator EMNLP 2025 Towards Harmonized Uncertainty Estimation for Large Language Models ACL 2025 Towards Higher Effective Rank in Parameter-Efficient Fine-tuning using Khatri-Rao Product ICCV 2025 Towards RAW Object Detection in Diverse Conditions CVPR 2025 Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectory CVPR 2025 Towards the Law of Capacity Gap in Distilling Language Models ACL 2025 Towards Universal Dataset Distillation via Task-Driven Diffusion CVPR 2025 ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025