← Application Areas
Machine Learning › Application Areas ›

Knowledge Distillation

2907 directly classified papers

Papers per year

Papers

DISK-CSV: Distilling Interpretable Semantic Knowledge with a Class Semantic Vector EACL 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021
Amalgamating Knowledge From Heterogeneous Graph Neural Networks CVPR 2021
Teachers Do More Than Teach: Compressing Image-to-Image Models CVPR 2021
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-Bit Neural Networks via Guided Distribution Calibration CVPR 2021
Data-Free Knowledge Distillation for Heterogeneous Federated Learning ICML 2021
Dialect Identification through Adversarial Learning and Knowledge Distillation on Romanian BERT EACL 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network IJCNLP 2021
Guiding Teacher Forcing with Seer Forcing for Neural Machine Translation IJCNLP 2021
Selective Knowledge Distillation for Neural Machine Translation IJCNLP 2021
NAIST English-to-Japanese Simultaneous Translation System for IWSLT 2021 Simultaneous Text-to-text Task IJCNLP 2021
On Knowledge Distillation for Translating Erroneous Speech Transcriptions IJCNLP 2021
Multi-stage Pre-training over Simplified Multimodal Pre-training Models ACL 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning CVPR 2021
Speech Emotion Recognition via Multi-Level Cross-Modal Distillation INTERSPEECH 2021
Continual Learning for Fake Audio Detection INTERSPEECH 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task IJCNLP 2021
FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task IJCNLP 2021
Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation IJCNLP 2021
Claim Matching Beyond English to Scale Global Fact-Checking IJCNLP 2021
The USYD-JD Speech Translation System for IWSLT2021 IJCNLP 2021
Samsung R&D Institute Poland submission to WAT 2021 Indic Language Multilingual Task IJCNLP 2021
Universal Trading for Order Execution with Oracle Policy Distillation AAAI 2021
PRAL: A Tailored Pre-Training Model for Task-Oriented Dialog Generation IJCNLP 2021
Generating Landmark Navigation Instructions from Maps as a Graph-to-Text Problem IJCNLP 2021