← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Multilingual Continual Learning using Attention Distillation COLING 2025
A Knowledge Distillation-Based Approach to Enhance Transparency of Classifier Models AAAI 2025
TeEFusion: Blending Text Embeddings to Distill Classifier-Free Guidance ICCV 2025
Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models ICCV 2025
VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025
Fed-DFA: Federated Distillation for Heterogeneous Model Fusion Through the Adversarial Lens AAAI 2025
FedVCK: Non-IID Robust and Communication-Efficient Federated Learning via Valuable Condensed Knowledge for Medical Image Analysis AAAI 2025
Can Students Beyond the Teacher? Distilling Knowledge from Teacher’s Bias AAAI 2025
Federated Learning with Heterogeneous LLMs: Integrating Small Student Client Models with a Large Hungry Model AAAI 2025
Multimodal Commonsense Knowledge Distillation for Visual Question Answering (Student Abstract) AAAI 2025
Noisy Node Classification by Bi-level Optimization Based Multi-Teacher Distillation AAAI 2025
Natural Language Generation with Expert Standards AAAI 2025
Efficient Traffic Prediction Through Spatio-Temporal Distillation AAAI 2025
2-in-1 Phishing Detection via Large LM Distillation and Small LM Perturbation (Student Abstract) AAAI 2025
On Local Overfitting and Forgetting in Deep Neural Networks AAAI 2025
A Compact Model for Mathematics Problem Representations Distilled from BERT AAAI 2025
ConDo: Continual Domain Expansion for Absolute Pose Regression AAAI 2025
Interweaving Memories of a Siamese Large Language Model AAAI 2025
Embodied Navigation with Auxiliary Task of Action Description Prediction ICCV 2025
DGCPL: Dual Graph Distillation for Concept Prerequisite Relation Learning IJCAI 2025
LVPTrack: High Performance Domain Adaptive UAV Tracking with Label Aligned Visual Prompt Tuning AAAI 2025
Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025
Cluster Based Heterogeneous Federated Foundation Model Adaptation and Fine-Tuning AAAI 2025
Incongruent Multimodal Federated Learning for Medical Vision and Language-based Multi-label Disease Detection AAAI 2025
Divide-and-Conquer for Enhancing Unlabeled Learning, Stability, and Plasticity in Semi-supervised Continual Learning ICCV 2025