knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Efficient Dynamic Ensembling for Multiple LLM Experts IJCAI 2025

Curriculum Hierarchical Knowledge Distillation for Bias-Free Survival Prediction IJCAI 2025

Heavy Labels Out! Dataset Distillation with Label Space Lightening ICCV 2025

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process WACV 2025

Towards Harmonized Uncertainty Estimation for Large Language Models ACL 2025

Knockoff Branch: Model Stealing Attack via Adding Neurons in the Pre-Trained Model WACV 2025

Efficient Diffusion as Low Light Enhancer CVPR 2025

Maximizing the Effectiveness of Larger BERT Models for Compression ACL 2025

AIDE: Improving 3D Open-Vocabulary Semantic Segmentation by Aligned Vision-Language Learning WACV 2025

RTSM: Knowledge Distillation with Diverse Signals for Efficient Real-Time Semantic Matching in E-Commerce NAACL 2025

Distill-C: Enhanced NL2SQL via Distilled Customization with LLMs NAACL 2025

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models ACL 2025

DisComp: A Two-Stage Prompt Optimization Framework Combining Task-Agnostic and Task-Aware Compression NAACL 2025

Disentangling Spatio-Temporal Knowledge for Weakly Supervised Object Detection and Segmentation in Surgical Video WACV 2025

Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs ACL 2025

Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting NAACL 2025

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025

uDistil-Whisper: Label-Free Data Filtering for Knowledge Distillation in Low-Data Regimes NAACL 2025

Bridging the Visual Gap: Fine-Tuning Multimodal Models with Knowledge-Adapted Captions NAACL 2025

MLAS-LoRA: Language-Aware Parameters Detection and LoRA-Based Knowledge Transfer for Multilingual Machine Translation ACL 2025

PromptOptMe: Error-Aware Prompt Compression for LLM-based MT Evaluation Metrics NAACL 2025

Reverse Thinking Makes LLMs Stronger Reasoners NAACL 2025

Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? ACL 2025

UNDIAL: Self-Distillation with Adjusted Logits for Robust Unlearning in Large Language Models NAACL 2025

Auto-Cypher: Improving LLMs on Cypher generation via LLM-supervised generation-verification framework NAACL 2025