conftrace_

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Fast and Accurate Gigapixel Pathological Image Classification with Hierarchical Distillation Multi-Instance Learning CVPR 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers WACV 2025

Emo Pillars: Knowledge Distillation to Support Fine-Grained Context-Aware and Context-Less Emotion Classification ACL 2025

TEACH: A Contrastive Knowledge Adaptive Distillation Framework for Classical Chinese Understanding ACL 2025

Semantic Alignment and Reinforcement for Data-Free Quantization of Vision Transformers ICCV 2025

LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation ACL 2025

Enhanced Event-based Dense Stereo via Cross-Sensor Knowledge Distillation ICCV 2025

Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data CVPR 2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation ICCV 2025

Distilling Spatially-Heterogeneous Distortion Perception for Blind Image Quality Assessment CVPR 2025

Unleashing Vecset Diffusion Model for Fast Shape Generation ICCV 2025

Towards Adapting Open-Source Large Language Models for Expert-Level Clinical Note Generation ACL 2025

Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025

Gumbel Reranking: Differentiable End-to-End Reranker Optimization ACL 2025

Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation COLING 2025

BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motions CVPR 2025

Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learning ICCV 2025

AIDE: Attribute-Guided MultI-Hop Data Expansion for Data Scarcity in Task-Specific Fine-tuning ACL 2025

EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025

StitchLLM: Serving LLMs, One Block at a Time ACL 2025

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation ICCV 2025

Tracr-Injection: Distilling Algorithms into Pre-trained Language Models ACL 2025

Revisiting Weak-to-Strong Generalization in Theory and Practice: Reverse KL vs. Forward KL ACL 2025

Towards Faithful Multi-step Reasoning through Fine-Grained Causal-aware Attribution Reasoning Distillation COLING 2025