← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Task-agnostic Distillation of Encoder-Decoder Language Models COLING 2024
Joint Input and Output Coordination for Class-Incremental Learning IJCAI 2024
TAeKD: Teacher Assistant Enhanced Knowledge Distillation for Closed-Source Multilingual Neural Machine Translation COLING 2024
Sinkhorn Distance Minimization for Knowledge Distillation COLING 2024
Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection IJCAI 2024
Self-Supervised Quantization-Aware Knowledge Distillation AISTATS 2024
Deep Classifier Mimicry without Data Access AISTATS 2024
3MVRD: Multimodal Multi-task Multi-teacher Visually-Rich Form Document Understanding ACL 2024
ADAM: Dense Retrieval Distillation with Adaptive Dark Examples ACL 2024
Study Selectively: An Adaptive Knowledge Distillation based on a Voting Network for Heart Sound Classification INTERSPEECH 2024
tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models INTERSPEECH 2024
Exploring compressibility of transformer based text-to-music (TTM) models INTERSPEECH 2024
Learning Fine-Grained Controllability on Speech Generation via Efficient Fine-Tuning INTERSPEECH 2024
Efficient Speaker Embedding Extraction Using a Twofold Sliding Window Algorithm for Speaker Diarization INTERSPEECH 2024
LungAdapter: Efficient Adapting Audio Spectrogram Transformer for Lung Sound Classification INTERSPEECH 2024
Evolving Knowledge Distillation with Large Language Models and Active Learning COLING 2024
Effective Distillation of Table-based Reasoning Ability from LLMs COLING 2024
Distillation with Explanations from Large Language Models COLING 2024
S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity NIPS 2024
Large Language Models for Human-AI Co-Creation of Robotic Dance Performances IJCAI 2024
Cross-Problem Learning for Solving Vehicle Routing Problems IJCAI 2024
An Image-enhanced Molecular Graph Representation Learning Framework IJCAI 2024
FREE: Faster and Better Data-Free Meta-Learning CVPR 2024
LLM-based Multi-Level Knowledge Generation for Few-shot Knowledge Graph Completion IJCAI 2024
OD-DETR: Online Distillation for Stabilizing Training of Detection Transformer IJCAI 2024