knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning ACL 2025

What to Distill? Fast Knowledge Distillation with Adaptive Sampling ICCV 2025

Knowledge Distillation with Refined Logits ICCV 2025

VRM: Knowledge Distillation via Virtual Relation Matching ICCV 2025

Robust Utility-Preserving Text Anonymization Based on Large Language Models ACL 2025

You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data ICCV 2025

Task-Aware Prompt Gradient Projection for Parameter-Efficient Tuning Federated Class-Incremental Learning ICCV 2025

InterMimic: Towards Universal Whole-Body Control for Physics-Based Human-Object Interactions CVPR 2025

Active Data Curation Effectively Distills Large-Scale Multimodal Models CVPR 2025

VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Step CVPR 2025

Random Conditioning for Diffusion Model Compression with Distillation CVPR 2025

Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks CVPR 2025

Basic Reading Distillation ACL 2025

Dual-Process Image Generation ICCV 2025

Investigating the Transferability of Code Repair for Low-Resource Programming Languages NAACL 2025

Spatial-Temporal Knowledge Distillation for Takeaway Recommendation AAAI 2025

SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models NAACL 2025

Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications ACL 2025

Huatuo-26M, a Large-scale Chinese Medical QA Dataset NAACL 2025

DistilQwen2.5: Industrial Practices of Training Distilled Open Lightweight Language Models ACL 2025

Efficient Speech Translation through Model Compression and Knowledge Distillation ACL 2025

Tackling Long-Tailed Data Challenges in Spiking Neural Networks via Heterogeneous Knowledge Distillation IJCAI 2025

Lightweight Contenders: Navigating Semi-Supervised Text Mining through Peer Collaboration and Self Transcendence NAACL 2025

Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025

Bootstrapping Grounded Chain-of-Thought in Multimodal LLMs for Data-Efficient Model Adaptation ICCV 2025