conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025
UIPro: Unleashing Superior Interaction Capability For GUI Agents ICCV 2025
Large Language Model as a Teacher for Zero-shot Tagging at Extreme Scales COLING 2025
Multilingual Iterative Model Pruning: What Matters? AACL 2025
Modal Feature Optimization Network with Prompt for Multimodal Sentiment Analysis COLING 2025
MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities AAAI 2025
DistillDrive: End-to-End Multi-Mode Autonomous Driving Distillation by Isomorphic Hetero-Source Planning Model ICCV 2025
Agreement-Constrained Probabilistic Minimum Bayes Risk Decoding AACL 2025
Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillation ACL 2025
Enhancing Cross-Tokenizer Knowledge Distillation with Contextual Dynamical Mapping ACL 2025
Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images ICCV 2025
Training Deep Neural Networks with Virtual Smoothing Classes AAAI 2025
CycleDistill: Bootstrapping Machine Translation using LLMs with Cyclical Distillation AACL 2025
Adversarial Distribution Matching for Diffusion Distillation Towards Efficient Image and Video Synthesis ICCV 2025
Distillation versus Contrastive Learning: How to Train Your Rerankers AACL 2025
CEMIL: Contextual Attention Based Efficient Weakly Supervised Approach for Histopathology Image Classification WACV 2025
Multi-Level Feature Distillation of Joint Teachers Trained on Distinct Image Datasets WACV 2025
Uncertainty-Guided Cross Attention Ensemble Mean Teacher for Semi-Supervised Medical Image Segmentation WACV 2025
Dropout Connects Transformers and CNNs: Transfer General Knowledge for Knowledge Distillation WACV 2025
3DM: Distill, Dynamic Drop, and Merge for Debiasing Multi-modal Large Language Models ACL 2025
MALTO at SemEval-2025 Task 4: Dual Teachers for Unlearning Sensitive Content in LLMs ACL 2025
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction ACL 2025
DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models ACL 2025
AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuning ACL 2025
BayesKD: Bayesian Knowledge Distillation for Compact LLMs in Constrained Fine-tuning Scenarios ACL 2025