← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

OGP-Net: Optical Guidance Meets Pixel-Level Contrastive Distillation for Robust Multi-Modal and Missing Modality Segmentation AAAI 2025
Multilingual Iterative Model Pruning: What Matters? IJCNLP 2025
Classifier-guided CLIP Distillation for Unsupervised Multi-label Classification CVPR 2025
ATLANTIS: Weak-to-Strong Learning via Importance Sampling ACL 2025
DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models ACL 2025
MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025
Uncertainty-Guided Cross Attention Ensemble Mean Teacher for Semi-Supervised Medical Image Segmentation WACV 2025
MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models AAAI 2025
Can LVLMs Obtain a Driver’s License? A Benchmark Towards Reliable AGI for Autonomous Driving AAAI 2025
3D Annotation-Free Learning by Distilling 2D Open-Vocabulary Segmentation Models for Autonomous Driving AAAI 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
Debiased Distillation for Consistency Regularization AAAI 2025
Modal Feature Optimization Network with Prompt for Multimodal Sentiment Analysis COLING 2025
Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction AAAI 2025
FedCPD:Personalized Federated Learning with Prototype-Enhanced Representation and Memory Distillation IJCAI 2025
GCD: Advancing Vision-Language Models for Incremental Object Detection via Global Alignment and Correspondence Distillation AAAI 2025
FIND: Few-Shot Anomaly Inspection with Normal-Only Multi-Modal Data ICCV 2025
LVPTrack: High Performance Domain Adaptive UAV Tracking with Label Aligned Visual Prompt Tuning AAAI 2025
The Gemma Sutras: Fine-Tuning Gemma 3 for Sanskrit Sandhi Splitting EMNLP 2025
DASK: Distribution Rehearsing via Adaptive Style Kernel Learning for Exemplar-Free Lifelong Person Re-Identification AAAI 2025
On the Analysis and Distillation of Emergent Outlier Properties in Pre-trained Language Models NAACL 2025
3D Denoisers Are Good 2D Teachers: Molecular Pretraining via Denoising and Cross-Modal Distillation AAAI 2025
3CAD: A Large-Scale Real-World 3C Product Dataset for Unsupervised Anomaly Detection AAAI 2025
Dual Information Purification for Lightweight SAR Object Detection AAAI 2025
Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptation AAAI 2025