knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Two Heads Are Better than One: Distilling Large Language Model Features into Small Models with Feature Decomposition and Mixture AAAI 2026

EM-KD: Distilling Efficient Multimodal Large Language Model with Unbalanced Vision Tokens AAAI 2026

IGT4ETH: An Isotropic Pre-trained Graph Transformer for Ethereum Account Classification AAAI 2026

Balanced Knowledge Distillation for Large Language Models with Mix-of-Experts AAAI 2026

D2 Prune: Sparsifying Large Language Models via Dual Taylor Expansion and Attention Distribution Awareness AAAI 2026

HanjaBridge: Resolving Semantic Ambiguity in Korean LLMs via Hanja-Augmented Pre-Training AAAI 2026

MCW-KD: Multi-Cost Wasserstein Knowledge Distillation for Large Language Models AAAI 2026

Improving Implicit Discourse Relation Recognition with Natural Language Explanations from LLMs AAAI 2026

StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs Through Knowledge-Reasoning Fusion AAAI 2026

RLKD: Distilling LLMs’ Reasoning via Reinforcement Learning AAAI 2026

MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge Through Group Direct Preference Optimization AAAI 2026

Don’t Start Over: A Cost-Effective Framework for Migrating Personalized Prompts Between LLMs AAAI 2026

Dual Information Purification for Lightweight SAR Object Detection AAAI 2025

Multilingual Continual Learning using Attention Distillation COLING 2025

FOCUS: Towards Universal Foreground Segmentation AAAI 2025

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025

SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection AAAI 2025

DCA: Dividing and Conquering Amnesia in Incremental Object Detection AAAI 2025

Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking CVPR 2025

Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025

Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025

Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging CVPR 2025

Embodied Navigation with Auxiliary Task of Action Description Prediction ICCV 2025

Inference-Time Diffusion Model Distillation ICCV 2025

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration AAAI 2025