← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Disentangled Contrastive Bundle Recommendation with Conditional Diffusion AAAI 2025
DAViD: Modeling Dynamic Affordance of 3D Objects Using Pre-trained Video Diffusion Models ICCV 2025
Adding Additional Control to One-Step Diffusion with Joint Distribution Matching ICCV 2025
Memorization Inheritance in Sequence-Level Knowledge Distillation for Neural Machine Translation ACL 2025
ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation ICCV 2025
One-Shot Knowledge Transfer for Scalable Person Re-Identification ICCV 2025
A Good Teacher Adapts Their Knowledge for Distillation ICCV 2025
TreeRAG: Unleashing the Power of Hierarchical Storage for Enhanced Knowledge Retrieval in Long Documents ACL 2025
GuiLoMo: Allocating Experts and Ranks for LoRA-MoE via Bilevel Optimization with GuidedSelection Vectors EMNLP 2025
Active Large Language Model-Based Knowledge Distillation for Session-Based Recommendation AAAI 2025
Balancing Speciality and Versatility: a Coarse to Fine Framework for Supervised Fine-tuning Large Language Model ACL 2024
Teaching Small Language Models to Reason for Knowledge-Intensive Multi-Hop Question Answering ACL 2024
Sentence-wise Speech Summarization: Task, Datasets, and End-to-End Modeling with LM Knowledge Distillation INTERSPEECH 2024
DMoERM: Recipes of Mixture-of-Experts for Effective Reward Modeling ACL 2024
Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning ACL 2024
Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation ACL 2024
Prompting Large Language Models with Audio for General-Purpose Speech Summarization INTERSPEECH 2024
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024
API-BLEND: A Comprehensive Corpora for Training and Benchmarking API LLMs ACL 2024
AS-ES Learning: Towards efficient CoT learning in small models ACL 2024
Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models INTERSPEECH 2024
Knowledge Distillation from Self-Supervised Representation Learning Model with Discrete Speech Units for Any-to-Any Streaming Voice Conversion INTERSPEECH 2024
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages ACL 2024
Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models ACL 2024
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024