knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Inference-Time Diffusion Model Distillation ICCV 2025

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025

Embodied Navigation with Auxiliary Task of Action Description Prediction ICCV 2025

LLaVA-KD: A Framework of Distilling Multimodal Large Language Models ICCV 2025

AnnofreeOD: Detecting All Classes at Low Frame Rates Without Human Annotations ICCV 2025

Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning ICCV 2025

Dual-Expert Consistency Model for Efficient and High-Quality Video Generation ICCV 2025

Dense2MoE: Restructuring Diffusion Transformer to MoE for Efficient Text-to-Image Generation ICCV 2025

Distilling Diffusion Models to Efficient 3D LiDAR Scene Completion ICCV 2025

CMAD: Correlation-Aware and Modalities-Aware Distillation for Multimodal Sentiment Analysis with Missing Modalities ICCV 2025

LiT: Delving into a Simple Linear Diffusion Transformer for Image Generation ICCV 2025

Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster EMNLP 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025

Semantic Alignment and Reinforcement for Data-Free Quantization of Vision Transformers ICCV 2025

KULFi Framework: Knowledge Utilization for Optimizing Large Language Models for Financial Causal Reasoning COLING 2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation ICCV 2025

Unleashing Vecset Diffusion Model for Fast Shape Generation ICCV 2025

Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025

S4M: Boosting Semi-Supervised Instance Segmentation with SAM ICCV 2025

Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learning ICCV 2025

PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation EMNLP 2025

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation ICCV 2025

KDA: Knowledge Diffusion Alignment with Enhanced Context for Video Temporal Grounding ICCV 2025

FISTAPruner: Layer-wise Post-training Pruning for Large Language Models EMNLP 2025