Knowledge Distillation

RandLoRA: Full rank parameter-efficient fine-tuning of large models ICLR 2025 Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025 Rationale-Guided Distillation for E-Commerce Relevance Classification: Bridging Large Language Models and Lightweight Cross-Encoders COLING 2025 RCTDistill: Cross-Modal Knowledge Distillation Framework for Radar-Camera 3D Object Detection with Temporal Fusion ICCV 2025 Real-Time Neural Denoising with Render-Aware Knowledge Distillation AAAI 2025 Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy IJCAI 2025 Recall with Reasoning: Chain-of-Thought Distillation for Mamba’s Long-Context Memory and Extrapolation EMNLP 2025 Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation EMNLP 2025 ReflectionCoder: Learning from Reflection Sequence for Enhanced One-off Code Generation ACL 2025 Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025 Relational Self-Supervised Distillation with Compact Descriptors for Image Copy Detection WACV 2025 Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA ICLR 2025 Reliable and Diverse Evaluation of LLM Medical Knowledge Mastery ICLR 2025 ResidualViT for Efficient Temporally Dense Video Encoding ICCV 2025 Resource-Efficient Anonymization of Textual Data via Knowledge Distillation from Large Language Models COLING 2025 Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation CVPR 2025 Rethinking and Improving Student Learning and Forgetting Processes for Attention based Knowledge Tracing Models AAAI 2025 Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models COLING 2025 Rethinking Multi-modal Object Detection from the Perspective of Mono-Modality Feature Learning ICCV 2025 Rethinking Self-Distillation: Label Averaging and Enhanced Soft Label Refinement with Partial Labels ICLR 2025 Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction ACL 2025 Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn’t Matter (Much) IJCNLP 2025 RLDG: Robotic Generalist Policy Distillation via Reinforcement Learning RSS 2025 Robust Utility-Preserving Text Anonymization Based on Large Language Models ACL 2025 Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inference ICLR 2025