knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Optimizing Quantized Diffusion Models via Distillation with Cross-Timestep Error Correction AAAI 2025

NAAM: Node-Aware Attention Mechanism for Distilling GNNs-to-MLP (Student Abstract) AAAI 2025

Adaptive Computation Modules: Granular Conditional Computation for Efficient Inference AAAI 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

KD-MSLRT: Lightweight Sign Language Recognition Model Based on Mediapipe and 3D to 1D Knowledge Distillation AAAI 2025

LoRA Unlearns More and Retains More (Student Abstract) AAAI 2025

Dynamic Expansion Diffusion Learning for Lifelong Generative Modelling AAAI 2025

DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025

Real-Time Neural Denoising with Render-Aware Knowledge Distillation AAAI 2025

LAGD: Local Topological-Alignment and Global Semantic-Deconstruction for Incremental 3D Semantic Segmentation AAAI 2025

Confound from All Sides, Distill with Resilience: Multi-Objective Adversarial Paths to Zero-Shot Robustness ICCV 2025

Leveraging Large Language Models for Active Merchant Non-player Characters IJCAI 2025

All You Need in Knowledge Distillation Is a Tailored Coordinate System AAAI 2025

Incongruent Multimodal Federated Learning for Medical Vision and Language-based Multi-label Disease Detection AAAI 2025

Inheriting Generalized Learngene for Efficient Knowledge Transfer across Multiple Tasks AAAI 2025

Dense2MoE: Restructuring Diffusion Transformer to MoE for Efficient Text-to-Image Generation ICCV 2025

Logic Distillation: Learning from Code Function by Function for Decision-making Tasks IJCAI 2025

Distilling Diffusion Models to Efficient 3D LiDAR Scene Completion ICCV 2025

Imputation-free Incomplete Multi-view Clustering via Knowledge Distillation IJCAI 2025

Recalling The Forgotten Class Memberships: Unlearned Models Can Be Noisy Labelers to Leak Privacy IJCAI 2025

Dual-Expert Consistency Model for Efficient and High-Quality Video Generation ICCV 2025

CMAD: Correlation-Aware and Modalities-Aware Distillation for Multimodal Sentiment Analysis with Missing Modalities ICCV 2025

AnnofreeOD: Detecting All Classes at Low Frame Rates Without Human Annotations ICCV 2025

FedCPD:Personalized Federated Learning with Prototype-Enhanced Representation and Memory Distillation IJCAI 2025

Augmenting Moment Retrieval: Zero-Dependency Two-Stage Learning ICCV 2025