knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Distilling Structured Rationale from Large Language Models to Small Language Models for Abstractive Summarization AAAI 2025

Multimodal Commonsense Knowledge Distillation for Visual Question Answering (Student Abstract) AAAI 2025

Both Supply and Precision: Sample Debias and Ranking Consistency Joint Learning for Large Scale Pre-Ranking System AAAI 2025

Henry at BEA 2025 Shared Task: Improving AI Tutor’s Guidance Evaluation Through Context-Aware Distillation ACL 2025

Filling Memory Gaps: Enhancing Continual Semantic Parsing via SQL Syntax Variance-Guided LLMs Without Real Data Replay AAAI 2025

Confound from All Sides, Distill with Resilience: Multi-Objective Adversarial Paths to Zero-Shot Robustness ICCV 2025

Semantic Alignment and Reinforcement for Data-Free Quantization of Vision Transformers ICCV 2025

Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal AAAI 2025

Winning Big with Small Models: Knowledge Distillation vs. Self-Training for Reducing Hallucination in QA Agents ACL 2025

Efficient Federated Learning via Clients-to-Server Knowledge Distillation (Student Abstract) AAAI 2025

DOLLAR: Few-Step Video Generation via Distillation and Latent Reward Optimization ICCV 2025

LLM-assisted Entropy-based Adaptive Distillation for Unsupervised Fine-grained Visual Representation Learning ICCV 2025

Procedure Knowledge Decoupled Distillation Strategy for Procedure Planning in Instructional Videos AAAI 2025

Fuse Before Transfer: Knowledge Fusion for Heterogeneous Distillation ICCV 2025

S4M: Boosting Semi-Supervised Instance Segmentation with SAM ICCV 2025

Photolithography Overlay Map Generation with Implicit Knowledge Distillation Diffusion Transformer ICCV 2025

Unleashing Vecset Diffusion Model for Fast Shape Generation ICCV 2025

Integrating Task-Specific and Universal Adapters for Pre-Trained Model-based Class-Incremental Learning ICCV 2025

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models ICCV 2025

EgoAdapt: Adaptive Multisensory Distillation and Policy Learning for Efficient Egocentric Perception ICCV 2025

Perspective-Aware Teaching: Adapting Knowledge for Heterogeneous Distillation ICCV 2025

EC-Flow: Enabling Versatile Robotic Manipulation from Action-Unlabeled Videos via Embodiment-Centric Flow ICCV 2025

EA-KD: Entropy-based Adaptive Knowledge Distillation ICCV 2025

Hybrid Annotation for Propaganda Detection: Integrating LLM Pre-Annotations with Human Intelligence ACL 2025

KD-MSLRT: Lightweight Sign Language Recognition Model Based on Mediapipe and 3D to 1D Knowledge Distillation AAAI 2025