conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Distilling Effective Supervision From Severe Label Noise CVPR 2020
The Knowledge Within: Methods for Data-Free Model Compression CVPR 2020
Dreaming to Distill: Data-Free Knowledge Transfer via DeepInversion CVPR 2020
Search to Distill: Pearls Are Everywhere but Not the Eyes CVPR 2020
Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation EMNLP 2020
Learning Voice Representation Using Knowledge Distillation for Automatic Voice Casting INTERSPEECH 2020
Intra-Utterance Similarity Preserving Knowledge Distillation for Audio Tagging INTERSPEECH 2020
Towards Oracle Knowledge Distillation with Neural Architecture Search AAAI 2020
ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation ACL 2020
Improving Non-autoregressive Neural Machine Translation with Monolingual Data ACL 2020
Cloze Distillation: Improving Neural Language Models with Human Next-Word Prediction EMNLP 2020
Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning EMNLP 2020
Improving Word Embedding Factorization for Compression Using Distilled Nonlinear Neural Decomposition EMNLP 2020
Language Model Prior for Low-Resource Neural Machine Translation EMNLP 2020
The Volctrans Machine Translation System for WMT20 EMNLP 2020
HW-TSC’s Participation in the WMT 2020 News Translation Shared Task EMNLP 2020
TinyBERT: Distilling BERT for Natural Language Understanding EMNLP 2020
Multi-Agent Mutual Learning at Sentence-Level and Token-Level for Neural Machine Translation EMNLP 2020
Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP EMNLP 2020
Assessment of DistilBERT performance on Named Entity Recognition task for the detection of Protected Health Information and medical concepts EMNLP 2020
Improving Event Detection via Open-domain Trigger Knowledge ACL 2020
SimulSpeech: End-to-End Simultaneous Speech to Text Translation ACL 2020
A Study of Non-autoregressive Model for Sequence Generation ACL 2020
Knowledge Distillation for Multilingual Unsupervised Neural Machine Translation ACL 2020
Integrating Relation Constraints with Neural Relation Extractors AAAI 2020