knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

HFD-Teacher: High-Frequency Depth Distillation from Depth Foundation Models for Enhanced Depth Completion ICCV 2025

Agreement-Constrained Probabilistic Minimum Bayes Risk Decoding AACL 2025

Inference-Time Diffusion Model Distillation ICCV 2025

Co-Progression Knowledge Distillation with Knowledge Prototype for Industrial Anomaly Detection AAAI 2025

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting ICCV 2025

Entire-Space Variational Information Exploitation for Post-Click Conversion Rate Prediction AAAI 2025

Embodied Navigation with Auxiliary Task of Action Description Prediction ICCV 2025

Unlocking the Potential of Reverse Distillation for Anomaly Detection AAAI 2025

LLaVA-KD: A Framework of Distilling Multimodal Large Language Models ICCV 2025

Spatial-Temporal Knowledge Distillation for Takeaway Recommendation AAAI 2025

AnnofreeOD: Detecting All Classes at Low Frame Rates Without Human Annotations ICCV 2025

GroupMamba: Efficient Group-Based Visual State Space Model CVPR 2025

Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning ICCV 2025

Multi-modal Medical Diagnosis via Large-small Model Collaboration CVPR 2025

Dual-Expert Consistency Model for Efficient and High-Quality Video Generation ICCV 2025

Howard University-AI4PC at SemEval-2025 Task 4: Unlearning Sensitive Content From Large Language Models Using Finetuning and Distillation for Selective Knowledge Removal SEMEVAL 2025

ATLANTIS: Weak-to-Strong Learning via Importance Sampling ACL 2025

Learning from Committee: Reasoning Distillation from a Mixture of Teachers with Peer-Review ACL 2025

Distilling Diffusion Models to Efficient 3D LiDAR Scene Completion ICCV 2025

EdgeTAM: On-Device Track Anything Model CVPR 2025

A Compact Model for Mathematics Problem Representations Distilled from BERT AAAI 2025

Teaching Sarcasm: Few-Shot Multimodal Sarcasm Detection via Distillation to a Parameter-Efficient Student IJCNLP 2025

LiT: Delving into a Simple Linear Diffusion Transformer for Image Generation ICCV 2025

Revisiting Intermediate-Layer Matching in Knowledge Distillation: Layer-Selection Strategy Doesn’t Matter (Much) IJCNLP 2025

Natural Language Generation with Expert Standards AAAI 2025