Skip to content
conftrace_

knowledge distillation

4,137 papers

KD

Papers

SHARP-Distill: A 68× Faster Recommender System with Hypergraph Neural Networks and Language Models ICML 2025 Shy-hunyuan-MT at WMT25 General Machine Translation Shared Task EMNLP 2025 SIKeD: Self-guided Iterative Knowledge Distillation for Mathematical Reasoning ACL 2025 Sim4Rec: Data-Free Model Extraction Attack on Sequential Recommendation AAAI 2025 SimLTD: Simple Supervised and Semi-Supervised Long-Tailed Object Detection CVPR 2025 Simplification Is All You Need against Out-of-Distribution Overconfidence CVPR 2025 Simulating Dual-Process Thinking in Dialogue Topic Shift Detection COLING 2025 Single-Layer Distillation with Fourier Convolutions for Texture Anomaly Detection WACV 2025 Single Teacher, Multiple Perspectives: Teacher Knowledge Augmentation for Enhanced Knowledge Distillation ICLR 2025 Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement AAAI 2025 Sketch Down the FLOPs: Towards Efficient Networks for Human Sketch CVPR 2025 SkillTree: Explainable Skill-Based Deep Reinforcement Learning for Long-Horizon Control Tasks AAAI 2025 SKIntern: Internalizing Symbolic Knowledge for Distilling Better CoT Capabilities into Small Language Models COLING 2025 Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025 SLMRec: Distilling Large Language Models into Small for Sequential Recommendation ICLR 2025 Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling ICLR 2025 Small Models are LLM Knowledge Triggers for Medical Tabular Prediction ICLR 2025 Small Models Struggle to Learn from Strong Reasoners ACL 2025 SMDAF: A Scalable Sidewalk Material Data Acquisition Framework with Bidirectional Cross-Modal Knowledge Distillation WACV 2025 SMT: Fine-Tuning Large Language Models with Sparse Matrices ICLR 2025 SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Training CVPR 2025 Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model ICML 2025 SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation ICLR 2025 Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs ACL 2025 SparseSegNet: A Boundary-Aware Lightweight Segmentation Architecture for Skin Lesions ACML 2025