conftrace_
← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Two Heads Are Better than One: Distilling Large Language Model Features into Small Models with Feature Decomposition and Mixture AAAI 2026
EM-KD: Distilling Efficient Multimodal Large Language Model with Unbalanced Vision Tokens AAAI 2026
IGT4ETH: An Isotropic Pre-trained Graph Transformer for Ethereum Account Classification AAAI 2026
Balanced Knowledge Distillation for Large Language Models with Mix-of-Experts AAAI 2026
D2 Prune: Sparsifying Large Language Models via Dual Taylor Expansion and Attention Distribution Awareness AAAI 2026
HanjaBridge: Resolving Semantic Ambiguity in Korean LLMs via Hanja-Augmented Pre-Training AAAI 2026
MCW-KD: Multi-Cost Wasserstein Knowledge Distillation for Large Language Models AAAI 2026
Improving Implicit Discourse Relation Recognition with Natural Language Explanations from LLMs AAAI 2026
StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs Through Knowledge-Reasoning Fusion AAAI 2026
RLKD: Distilling LLMs’ Reasoning via Reinforcement Learning AAAI 2026
MetaGDPO: Alleviating Catastrophic Forgetting with Metacognitive Knowledge Through Group Direct Preference Optimization AAAI 2026
Don’t Start Over: A Cost-Effective Framework for Migrating Personalized Prompts Between LLMs AAAI 2026
Dual Information Purification for Lightweight SAR Object Detection AAAI 2025
Multilingual Continual Learning using Attention Distillation COLING 2025
FOCUS: Towards Universal Foreground Segmentation AAAI 2025
VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025
SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection AAAI 2025
DCA: Dividing and Conquering Amnesia in Incremental Object Detection AAAI 2025
Learning Occlusion-Robust Vision Transformers for Real-Time UAV Tracking CVPR 2025
Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025
Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025
Advancing Multiple Instance Learning with Continual Learning for Whole Slide Imaging CVPR 2025
Embodied Navigation with Auxiliary Task of Action Description Prediction ICCV 2025
Inference-Time Diffusion Model Distillation ICCV 2025
Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration AAAI 2025