← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation NAACL 2022
LM-CORE: Language Models with Contextually Relevant External Knowledge NAACL 2022
Harmless Transfer Learning for Item Embeddings NAACL 2022
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models NAACL 2022
When the Student Becomes the Master: Learning Better and Smaller Monolingual Models from mBERT COLING 2022
Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation CVPR 2022
It's All in the Teacher: Zero-Shot Quantization Brought Closer to the Teacher CVPR 2022
Enhancing Task-Specific Distillation in Small Data Regimes through Language Generation COLING 2022
Preservation of the Global Knowledge by Not-True Distillation in Federated Learning NIPS 2022
Information-Theoretic GAN Compression with Variational Energy-based Model NIPS 2022
Uncertainty-Aware Hierarchical Refinement for Incremental Implicitly-Refined Classification NIPS 2022
Efficient Knowledge Distillation from Model Checkpoints NIPS 2022
Learning Generalizable Models for Vehicle Routing Problems via Knowledge Distillation NIPS 2022
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation EMNLP 2022
How Many Observations Are Enough? Knowledge Distillation for Trajectory Forecasting CVPR 2022
Self-Distillation From the Last Mini-Batch for Consistency Regularization CVPR 2022
Dreaming To Prune Image Deraining Networks CVPR 2022
Model Compression Using Optimal Transport WACV 2022
Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games EMNLP 2022
Bitext Mining Using Distilled Sentence Representations for Low-Resource Languages EMNLP 2022
Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation CVPR 2022
Self-Distillation Based on High-level Information Supervision for Compressing End-to-End ASR Model INTERSPEECH 2022
Model Compression by Iterative Pruning with Knowledge Distillation and Its Application to Speech Enhancement INTERSPEECH 2022
Cross-Layer Similarity Knowledge Distillation for Speech Enhancement INTERSPEECH 2022
Self-Distillation with Meta Learning for Knowledge Graph Completion EMNLP 2022