knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity AAAI 2025

Target Semantics Clustering via Text Representations for Robust Universal Domain Adaptation AAAI 2025

RETRACTED: GEONet: Global Enhancement and Optimization Network for Lane Detection AAAI 2025

VL2Lite: Task-Specific Knowledge Distillation from Large Vision-Language Models to Lightweight Networks CVPR 2025

Closest Neighbors are Harmful for Lightweight Masked Auto-encoders CVPR 2025

One-Way Ticket: Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion Models CVPR 2025

Multi-Perspective Consolidation Enhanced Cognitive Diagnosis via Conditional Diffusion Model AAAI 2025

3CAD: A Large-Scale Real-World 3C Product Dataset for Unsupervised Anomaly Detection AAAI 2025

Retaining Knowledge and Enhancing Long-Text Representations in CLIP through Dual-Teacher Distillation CVPR 2025

Cross-Modal Distillation for 2D/3D Multi-Object Discovery from 2D Motion CVPR 2025

Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement AAAI 2025

TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpainting CVPR 2025

Detail-Preserving Latent Diffusion for Stable Shadow Removal CVPR 2025

Scaling Down Text Encoders of Text-to-Image Diffusion Models CVPR 2025

Knowledge Distillation for Learned Image Compression ICCV 2025

Latent Diffusion-Enhanced Virtual Try-On via Optimized Pseudo-Label Generation AAAI 2025

See Further When Clear: Curriculum Consistency Model CVPR 2025

FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation CVPR 2025

CAKE: Category Aware Knowledge Extraction for Open-Vocabulary Object Detection AAAI 2025

Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization AAAI 2025

DCSF-KD: Dynamic Channel-wise Spatial Feature Knowledge Distillation for Object Detection AAAI 2025

Synthetic Data is an Elegant GIFT for Continual Vision-Language Models CVPR 2025

A Stitch in Time Saves Nine: Small VLM is a Precise Guidance for Accelerating Large VLMs CVPR 2025

Intrinsic Image Decomposition for Robust Self-supervised Monocular Depth Estimation on Reflective Surfaces AAAI 2025

Text-Guided Fine-grained Counterfactual Inference for Short Video Fake News Detection AAAI 2025