← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Amalgamating Knowledge from Two Teachers for Task-oriented Dialogue System with Adversarial Training EMNLP 2020
Feature Adaptation of Pre-Trained Language Models across Languages and Domains with Robust Self-Training EMNLP 2020
Using the Past Knowledge to Improve Sentiment Classification EMNLP 2020
The NiuTrans Machine Translation Systems for WMT20 EMNLP 2020
FastFormers: Highly Efficient Transformer Models for Natural Language Understanding EMNLP 2020
Load What You Need: Smaller Versions of Mutililingual BERT EMNLP 2020
Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings EMNLP 2020
General Purpose Text Embeddings from Pre-trained Language Models for Scalable Inference EMNLP 2020
DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling EMNLP 2020
Towards Inheritable Models for Open-Set Domain Adaptation CVPR 2020
Online Knowledge Distillation via Collaborative Learning CVPR 2020
Regularizing Class-Wise Predictions via Self-Knowledge Distillation CVPR 2020
Explaining Knowledge Distillation by Quantifying the Knowledge CVPR 2020
Private-kNN: Practical Differential Privacy for Computer Vision CVPR 2020
Distilling Knowledge From Graph Convolutional Networks CVPR 2020
Vec2Face: Unveil Human Faces From Their Blackbox Features in Face Recognition CVPR 2020
P-KDGAN: Progressive Knowledge Distillation with GANs for One-class Novelty Detection IJCAI 2020
Variational Learning of Bayesian Neural Networks via Bayesian Dark Knowledge IJCAI 2020
Distill BERT to Traditional Models in Chinese Machine Reading Comprehension (Student Abstract) AAAI 2020
Distilling Knowledge from Well-Informed Soft Labels for Neural Relation Extraction AAAI 2020
Towards Making the Most of BERT in Neural Machine Translation AAAI 2020
Multi-Source Distilling Domain Adaptation AAAI 2020
Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization AAAI 2020
Improved Knowledge Distillation via Teacher Assistant AAAI 2020
Long Short-Term Sample Distillation AAAI 2020