Knowledge Distillation

QUADS: Quantized Distillation Framework for Efficient Speech Language Understanding Interspeech 2025 Quantification of Large Language Model Distillation ACL 2025 Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025 RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion ICCV 2025 Real-Time Neural Denoising with Render-Aware Knowledge Distillation AAAI 2025 Real-time TSE demonstration via SoundBeam with KD Interspeech 2025 Rebalancing Multi-Label Class-Incremental Learning AAAI 2025 Recurrent Knowledge Identification and Fusion for Language Model Continual Learning ACL 2025 Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025 ResidualViT for Efficient Temporally Dense Video Encoding ICCV 2025 Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation CVPR 2025 Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction ACL 2025 RETRACTED: GEONet: Global Enhancement and Optimization Network for Lane Detection AAAI 2025 SAFENUDGE: Safeguarding Large Language Models in Real-time with Tunable Safety-Performance Trade-offs EMNLP 2025 SALE-MLP: Structure Aware Latent Embeddings for GNN to Graph-free MLP Distillation IJCAI 2025 SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation ICCV 2025 ScaleOT: Privacy-utility-scalable Offsite-tuning with Dynamic LayerReplace and Selective Rank Compression AAAI 2025 Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems EMNLP 2025 SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection AAAI 2025 SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation AAAI 2025 SCRIBE: Structured Chain Reasoning for Interactive Behaviour Explanations using Tool Calling EMNLP 2025 See Further When Clear: Curriculum Consistency Model CVPR 2025 Self-Attentive Spatio-Temporal Calibration for Precise Intermediate Layer Matching in ANN-to-SNN Distillation AAAI 2025 Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning CVPR 2025 Semantic Segmentation on Raindrop Degraded Images Using Two-Stage Dual Teacher-Student Learning AAAI 2025