knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Models ICCV 2025

Bootstrapping Grounded Chain-of-Thought in Multimodal LLMs for Data-Efficient Model Adaptation ICCV 2025

Learning Together to Perform Better: Teaching Small-Scale LLMs to Collaborate via Preferential Rationale Tuning ACL 2025

Adding Additional Control to One-Step Diffusion with Joint Distribution Matching ICCV 2025

Distilling A Universal Expert from Clustered Federated Learning IJCAI 2025

LLMSR@XLLM25: Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation ACL 2025

TeEFusion: Blending Text Embeddings to Distill Classifier-Free Guidance ICCV 2025

FIND: Few-Shot Anomaly Inspection with Normal-Only Multi-Modal Data ICCV 2025

Heuristic-free Knowledge Distillation for Streaming ASR via Multi-modal Training AAAI 2025

Scaling Down, Serving Fast: Compressing and Deploying Efficient LLMs for Recommendation Systems EMNLP 2025

A Self-Distillation Recipe for Neural Machine Translation ACL 2025

ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025

Towards the Law of Capacity Gap in Distilling Language Models ACL 2025

Adaptive Dataset Quantization AAAI 2025

Aggregation Mechanism Based Graph Heterogeneous Networks Distillation IJCAI 2025

Multilingual Iterative Model Pruning: What Matters? AACL 2025

Adaptive Collaborative Labeling with MLLMs for Low-Resource Multimodal Emotion Recognition AACL 2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences ACL 2025

Encoder-Aware Sequence-Level Knowledge Distillation for Low-Resource Neural Machine Translation NAACL 2025

Enabling Visual Foundation Models to Teach Compact Students via Mixture of Distillation IJCAI 2025

Adapting Multilingual Embedding Models to Historical Luxembourgish NAACL 2025

Aligning Sizes of Intermediate Layers by LoRA Adapter for Knowledge Distillation NAACL 2025

Cross-modal Multi-task Learning for Multimedia Event Extraction AAAI 2025

A Good Teacher Adapts Their Knowledge for Distillation ICCV 2025

MIDAS: Multi-level Intent, Domain, And Slot Knowledge Distillation for Multi-turn NLU NAACL 2025