Knowledge Distillation

KDAT: Inherent Adversarial Robustness via Knowledge Distillation with Adversarial Tuning for Object Detection Models AAAI 2025 KDC-MAE: Knowledge Distilled Contrastive Mask Auto-Encoder WACV 2025 KD-MSLRT: Lightweight Sign Language Recognition Model Based on Mediapipe and 3D to 1D Knowledge Distillation AAAI 2025 KIKIS at WMT 2025 General Translation Task EMNLP 2025 Knockoff Branch: Model Stealing Attack via Adding Neurons in the Pre-Trained Model WACV 2025 Knockout LLM Assessment: Using Large Language Models for Evaluations through Iterative Pairwise Comparisons ACL 2025 Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models ACL 2025 Knowledge Decoupling via Orthogonal Projection for Lifelong Editing of Large Language Models ACL 2025 Knowledge Distillation for Language Models NAACL 2025 Knowledge Distillation for Learned Image Compression ICCV 2025 Knowledge Distillation with Multi-granularity Mixture of Priors for Image Super-Resolution ICLR 2025 Knowledge Distillation with Refined Logits ICCV 2025 KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025 L4: Mutual Learning Helps Lifelong Language Learning EMNLP 2025 Label Augmented Dataset Distillation WACV 2025 Large Language Model as a Teacher for Zero-shot Tagging at Extreme Scales COLING 2025 Large Language Model Meets Graph Neural Network in Knowledge Distillation AAAI 2025 Large Language Models Are Overparameterized Text Encoders NAACL 2025 Latte: Transfering LLMs' Latent-level Knowledge for Few-shot Tabular Learning IJCAI 2025 LaySummX at BioLaySumm: Retrieval-Augmented Fine-Tuning for Biomedical Lay Summarization Using Abstracts and Retrieved Full-Text Context ACL 2025 Learning Compatible Multi-Prize Subnetworks for Asymmetric Retrieval CVPR 2025 Learning Diagrams: A Graphical Language for Compositional Training Regimes ICLR 2025 Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025 Learning from Diverse Reasoning Paths with Routing and Collaboration EMNLP 2025 Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking CVPR 2025