← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Distilling Universal and Joint Knowledge for Cross-Domain Model Compression on Time Series Data IJCAI 2023
Multi-mode Neural Speech Coding Based on Deep Generative Networks INTERSPEECH 2023
Nkululeko: Machine Learning Experiments on Speaker Characteristics Without Programming INTERSPEECH 2023
DROID: Learning from Offline Heterogeneous Demonstrations via Reward-Policy Distillation CORL 2023
ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimation CORL 2023
Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective EACL 2023
You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models EACL 2023
The Unreasonable Effectiveness of Large Language-Vision Models for Source-Free Video Domain Adaptation ICCV 2023
Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation ICCV 2023
Dual Learning with Dynamic Knowledge Distillation for Partially Relevant Video Retrieval ICCV 2023
Distilling DETR with Visual-Linguistic Knowledge for Open-Vocabulary Object Detection ICCV 2023
Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data MIDL 2023
SFT-KD-Recon: Learning a Student-friendly Teacher for Knowledge Distillation in Magnetic Resonance Image Reconstruction MIDL 2023
Exploring All-In-One Knowledge Distillation Framework for Neural Machine Translation EMNLP 2023
Distill n’ Explain: explaining graph neural networks using simple surrogates AISTATS 2023
Learn and Sample Together: Collaborative Generation for Graphic Design Layout IJCAI 2023
Incorporating Unlikely Negative Cues for Distinctive Image Captioning IJCAI 2023
DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Driving IJCAI 2023
Low-Confidence Samples Mining for Semi-supervised Object Detection IJCAI 2023
Dual Relation Knowledge Distillation for Object Detection IJCAI 2023
Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks ACL 2023
Distilling Reasoning Capabilities into Smaller Language Models ACL 2023
Type Enhanced BERT for Correcting NER Errors ACL 2023
Cost-effective Distillation of Large Language Models ACL 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes ACL 2023