← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Efficient Transformer Knowledge Distillation: A Performance Review EMNLP 2023
Retrieve and Copy: Scaling ASR Personalization to Large Catalogs EMNLP 2023
Segment Any Point Cloud Sequences by Distilling Vision Foundation Models NIPS 2023
Strategic Data Sharing between Competitors NIPS 2023
Knowledge Distillation for High Dimensional Search Index NIPS 2023
Revisiting Adversarial Robustness Distillation from the Perspective of Robust Fairness NIPS 2023
Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from Backbone NIPS 2023
Token-Scaled Logit Distillation for Ternary Weight Generative Language Models NIPS 2023
Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale NIPS 2023
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation NIPS 2023
On student-teacher deviations in distillation: does it pay to disobey? NIPS 2023
What Knowledge Gets Distilled in Knowledge Distillation? NIPS 2023
Towards Efficient Pre-Trained Language Model via Feature Correlation Distillation NIPS 2023
MLFMF: Data Sets for Machine Learning for Mathematical Formalization NIPS 2023
Learning From Biased Soft Labels NIPS 2023
Collaborative Multi-Teacher Knowledge Distillation for Learning Low Bit-Width Deep Neural Networks WACV 2023
Backprop Induced Feature Weighting for Adversarial Domain Adaptation With Iterative Label Distribution Alignment WACV 2023
Understanding the Role of Mixup in Knowledge Distillation: An Empirical Study WACV 2023
Complementary Bi-Directional Feature Compression for Indoor 360deg Semantic Segmentation With Self-Distillation WACV 2023
Distilled Reverse Attention Network for Open-world Compositional Zero-Shot Learning ICCV 2023
Global Knowledge Calibration for Fast Open-Vocabulary Segmentation ICCV 2023
Data-free Knowledge Distillation for Fine-grained Visual Categorization ICCV 2023
A Unified Continual Learning Framework with General Parameter-Efficient Tuning ICCV 2023
Denoised Self-Augmented Learning for Social Recommendation IJCAI 2023
Teacher Assistant-Based Knowledge Distillation Extracting Multi-level Features on Single Channel Sleep EEG IJCAI 2023