← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Open-Set Short Utterance Forensic Speaker Verification Using Teacher-Student Network with Explicit Inductive Bias INTERSPEECH 2020
Improving On-Device Speaker Verification Using Federated Learning with Privacy INTERSPEECH 2020
Training Keyword Spotting Models on Non-IID Data with Federated Learning INTERSPEECH 2020
Towards Fast and Accurate Neural Chinese Word Segmentation with Multi-Criteria Learning COLING 2020
Knowledge Distillation from Internal Representations AAAI 2020
Inducing Relational Knowledge from BERT AAAI 2020
Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge Distillation AAAI 2020
InstaNAS: Instance-Aware Neural Architecture Search AAAI 2020
SSAH: Semi-Supervised Adversarial Deep Hashing with Self-Paced Hard Sample Generation AAAI 2020
An Efficient Framework for Dense Video Captioning AAAI 2020
Knowledge Base Embedding By Cooperative Knowledge Distillation COLING 2020
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing EMNLP 2020
Distilling Structured Knowledge for Text-Based Relational Reasoning EMNLP 2020
Bridging the Gap between Prior and Posterior Knowledge Selection for Knowledge-Grounded Dialogue Generation EMNLP 2020
BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover’s Distance EMNLP 2020
Contrastive Distillation on Intermediate Representations for Language Model Compression EMNLP 2020
Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data COLING 2020
Look One and More: Distilling Hybrid Order Relational Knowledge for Cross-Resolution Image Recognition AAAI 2020
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling ACL 2020
DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference ACL 2020
Efficient and High-Quality Neural Machine Translation with OpenNMT ACL 2020
Knowledge Integration Networks for Action Recognition AAAI 2020
Revisiting Knowledge Distillation via Label Smoothing Regularization CVPR 2020
Auxiliary Training: Towards Accurate and Robust Models CVPR 2020
Neural Network Pruning With Residual-Connections and Limited-Data CVPR 2020