Knowledge Distillation

Sens-Merging: Sensitivity-Guided Parameter Balancing for Merging Large Language Models ACL 2025 SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detection CVPR 2025 SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation CVPR 2025 Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025 SIKeD: Self-guided Iterative Knowledge Distillation for Mathematical Reasoning ACL 2025 Sim4Rec: Data-Free Model Extraction Attack on Sequential Recommendation AAAI 2025 Single-Layer Distillation with Fourier Convolutions for Texture Anomaly Detection WACV 2025 Single Teacher, Multiple Perspectives: Teacher Knowledge Augmentation for Enhanced Knowledge Distillation ICLR 2025 Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch CVPR 2025 SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models COLING 2025 Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025 Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves CVPR 2025 Slice-and-Pack: Tailoring Deep Models for Customized Requirements AAAI 2025 SLIM: Let LLM Learn More and Forget Less with Soft LoRA and Identity Mixture NAACL 2025 SLMRec: Distilling Large Language Models into Small for Sequential Recommendation ICLR 2025 Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling ICLR 2025 Small Models are LLM Knowledge Triggers for Medical Tabular Prediction ICLR 2025 Small Models Struggle to Learn from Strong Reasoners ACL 2025 SMDAF: A Scalable Sidewalk Material Data Acquisition Framework with Bidirectional Cross-Modal Knowledge Distillation WACV 2025 SMT: Fine-Tuning Large Language Models with Sparse Matrices ICLR 2025 SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training CVPR 2025 Soft Separation and Distillation: Toward Global Uniformity in Federated Unsupervised Learning ICCV 2025 Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs ACL 2025 Sparsity May Be All You Need: Sparse Random Parameter Adaptation EMNLP 2025 Spatial-Temporal Knowledge Distillation for Takeaway Recommendation AAAI 2025