← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

Why Knowledge Distillation Amplifies Gender Bias and How to Mitigate from the Perspective of DistilBERT NAACL 2022
Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022
Grounding in social media: An approach to building a chit-chat dialogue model NAACL 2022
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? ICML 2022
Boosting Multi-Label Image Classification with Complementary Parallel Self-Distillation IJCAI 2022
MGAD: Learning Descriptional Representation Distilled from Distributional Semantics for Unseen Entities IJCAI 2022
Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis INTERSPEECH 2022
Deep versus Wide: An Analysis of Student Architectures for Task-Agnostic Knowledge Distillation of Self-Supervised Speech Models INTERSPEECH 2022
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt IJCAI 2022
Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation INTERSPEECH 2022
Knowledge Distillation For CTC-based Speech Recognition Via Consistent Acoustic Representation Learning INTERSPEECH 2022
Production federated keyword spotting via distillation, filtering, and joint federated-centralized training INTERSPEECH 2022
Distilling Inter-Class Distance for Semantic Segmentation IJCAI 2022
BERT Learns to Teach: Knowledge Distillation with Meta Learning ACL 2022
MTRec: Multi-Task Learning over BERT for News Recommendation ACL 2022
Unifying the Convergences in Multilingual Neural Machine Translation EMNLP 2022
SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages EMNLP 2022
Attention Temperature Matters in Abstractive Summarization Distillation ACL 2022
Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation ACL 2022
Kronecker Decomposition for GPT Compression ACL 2022
Parameter-Efficient Abstractive Question Answering over Tables or Text ACL 2022
Distilled Dual-Encoder Model for Vision-Language Understanding EMNLP 2022
Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022
Structured Pruning Learns Compact and Accurate Models ACL 2022
Compression of Generative Pre-trained Language Models via Quantization ACL 2022