← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Improving Event Detection via Open-domain Trigger Knowledge ACL 2020
SimulSpeech: End-to-End Simultaneous Speech to Text Translation ACL 2020
A Study of Non-autoregressive Model for Sequence Generation ACL 2020
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation ACL 2020
Integrating Relation Constraints with Neural Relation Extractors AAAI 2020
MTSS: Learn from Multiple Domain Teachers and Become a Multi-Domain Dialogue Expert AAAI 2020
Learning Student Networks with Few Data AAAI 2020
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers AAAI 2020
Light Multi-Segment Activation for Model Compression AAAI 2020
A Unified Framework for Knowledge Intensive Gradient Boosting: Leveraging Human Experts for Noisy Sparse Domains AAAI 2020
Ensemble Approaches for Uncertainty in Spoken Language Assessment INTERSPEECH 2020
Go Wide, Then Narrow: Efficient Training of Deep Thin Networks ICML 2020
Audio-Visual Model Distillation Using Acoustic Images WACV 2020
Dual Policy Distillation IJCAI 2020
KoGuN: Accelerating Deep Reinforcement Learning via Integrating Human Suboptimal Knowledge IJCAI 2020
TKD: Temporal Knowledge Distillation for Active Perception WACV 2020
Learning End-to-End Scene Flow by Distilling Single Tasks Knowledge AAAI 2020
Implicit Transfer of Privileged Acoustic Information in a Generalized Knowledge Distillation Framework INTERSPEECH 2020
Self-Distillation for Improving CTC-Transformer-Based ASR Systems INTERSPEECH 2020
StrawNet: Self-Training WaveNet for TTS in Low-Data Regimes INTERSPEECH 2020
SAM: Squeeze-and-Mimic Networks for Conditional Visual Driving Policy Learning CORL 2020
DFQF: Data Free Quantization-aware Fine-tuning ACML 2020
Distilling Cross-Task Knowledge via Relationship Matching CVPR 2020
Self-Training With Noisy Student Improves ImageNet Classification CVPR 2020
The DeepMind Chinese–English Document Translation System at WMT2020 EMNLP 2020