knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

UIPro: Unleashing Superior Interaction Capability For GUI Agents ICCV 2025

Coupling the Generator with Teacher for Effective Data-Free Knowledge Distillation ICCV 2025

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data NAACL 2025

Model-based Large Language Model Customization as Service EMNLP 2025

Decoupled Distillation to Erase: A General Unlearning Method for Any Class-centric Tasks CVPR 2025

Split-Merge: Scalable and Memory-Efficient Merging of Expert LLMs EMNLP 2025

Focusing on What to Decode and What to Train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor WACV 2025

DPMamba: Distillation Prompt Mamba for Multimodal Remote Sensing Image Classification with Missing Modalities IJCAI 2025

Egocentric Object-Interaction Anticipation with Retentive and Predictive Learning IJCAI 2025

Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models EMNLP 2025

Efficient Dynamic Ensembling for Multiple LLM Experts IJCAI 2025

Dropout Connects Transformers and CNNs: Transfer General Knowledge for Knowledge Distillation WACV 2025

CoLA-Former: Graph Transformer Using Communal Linear Attention for Lightweight Sequential Recommendation IJCAI 2025

Weather Foundation Model Enhanced Decentralized Photovoltaic Power Forecasting Through Spatio-temporal Knowledge Distillation IJCAI 2025

Can Large Models Teach Student Models to Solve Mathematical Problems Like Human Beings? A Reasoning Distillation Method via Multi-LoRA Interaction IJCAI 2025

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture CVPR 2025

CD^2: Constrained Dataset Distillation for Few-Shot Class-Incremental Learning IJCAI 2025

SGC-Net: Stratified Granular Comparison Network for Open-Vocabulary HOI Detection CVPR 2025

Latte: Transfering LLMs' Latent-level Knowledge for Few-shot Tabular Learning IJCAI 2025

Boosting Short Text Classification with Multi-Source Information Exploration and Dual-Level Contrastive Learning AAAI 2025

EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport Alignments EMNLP 2025

UnCo: Uncertainty-Driven Collaborative Framework of Large and Small Models for Grounded Multimodal NER EMNLP 2025

Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information EMNLP 2025

Bridging the Gap: Efficient Cross-Lingual NER in Low-Resource Financial Domain COLING 2025

Cluster Based Heterogeneous Federated Foundation Model Adaptation and Fine-Tuning AAAI 2025