← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Mixture of LoRA Experts for Continual Information Extraction with LLMs EMNLP 2025
SkillTree: Explainable Skill-Based Deep Reinforcement Learning for Long-Horizon Control Tasks AAAI 2025
Connecting Giants: Synergistic Knowledge Transfer of Large Multimodal Models for Few-Shot Learning IJCAI 2025
You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025
BcQLM: Efficient Vision-Language Understanding with Distilled Q-Gated Cross-Modal Fusion EMNLP 2025
Fed-DFA: Federated Distillation for Heterogeneous Model Fusion Through the Adversarial Lens AAAI 2025
MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models EMNLP 2025
MimicGait: A Model Agnostic Approach for Occluded Gait Recognition using Correlational Knowledge Distillation WACV 2025
Cluster Based Heterogeneous Federated Foundation Model Adaptation and Fine-Tuning AAAI 2025
Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models COLING 2025
Momentum Posterior Regularization for Multi-hop Dense Retrieval COLING 2025
RUIE: Retrieval-based Unified Information Extraction using Large Language Model COLING 2025
Incongruent Multimodal Federated Learning for Medical Vision and Language-based Multi-label Disease Detection AAAI 2025
Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference AAAI 2025
QABISAR: Query-Article Bipartite Interactions for Statutory Article Retrieval COLING 2025
Improve Speech Translation Through Text Rewrite COLING 2025
FedVCK: Non-IID Robust and Communication-Efficient Federated Learning via Valuable Condensed Knowledge for Medical Image Analysis AAAI 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Toward Efficient Data-Free Unlearning AAAI 2025
Balancing Forget Quality and Model Utility: A Reverse KL-Divergence Knowledge Distillation Approach for Better Unlearning in LLMs NAACL 2025
Little Giants: Synthesizing High-Quality Embedding Data at Scale NAACL 2025
ToW: Thoughts of Words Improve Reasoning in Large Language Models NAACL 2025
Optimizing Quantized Diffusion Models via Distillation with Cross-Timestep Error Correction AAAI 2025
Reverse Thinking Makes LLMs Stronger Reasoners NAACL 2025
KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025