knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learning CVPR 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers WACV 2025

Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction ACL 2025

Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning ACL 2025

Semantic Alignment and Reinforcement for Data-Free Quantization of Vision Transformers ICCV 2025

LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025

Enhanced Event-based Dense Stereo via Cross-Sensor Knowledge Distillation ICCV 2025

Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data CVPR 2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation ICCV 2025

Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025

Unleashing Vecset Diffusion Model for Fast Shape Generation ICCV 2025

Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generation ACL 2025

Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025

Gumbel Reranking: Differentiable End-to-End Reranker Optimization ACL 2025

Leveraging Text-to-Text Transformers as Classifier Chain for Few-Shot Multi-Label Classification EMNLP 2025

BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions CVPR 2025

Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learning ICCV 2025

FedVCK: Non-IID Robust and Communication-Efficient Federated Learning via Valuable Condensed Knowledge for Medical Image Analysis AAAI 2025

EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025

StitchLLM: Serving LLMs, One Block at a Time ACL 2025

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation ICCV 2025

Tracr-Injection: Distilling Algorithms into Pre-trained Language Models ACL 2025

Toward Efficient Data-Free Unlearning AAAI 2025

CAKE: Category Aware Knowledge Extraction for Open-Vocabulary Object Detection AAAI 2025