← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

Knowledge Distillation Based Training of Universal ASR Source Models for Cross-Lingual Transfer INTERSPEECH 2021
ALP-KD: Attention-Based Layer Projection for Knowledge Distillation AAAI 2021
Audio-Oriented Multimodal Machine Comprehension via Dynamic Inter- and Intra-modality Attention AAAI 2021
Harmonized Dense Knowledge Distillation Training for Multi-Exit Architectures AAAI 2021
PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning AAAI 2021
LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding AAAI 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression EMNLP 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021
Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation EMNLP 2021
RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation EMNLP 2021
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding EMNLP 2021
GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021
Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021
deepQuest-py: Large and Distilled Models for Quality Estimation EMNLP 2021
Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation EMNLP 2021
Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding EMNLP 2021
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021
Distilling Knowledge for Empathy Detection EMNLP 2021
Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias EMNLP 2021
N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021
A Peek Into the Reasoning of Neural Networks: Interpreting With Structural Visual Concepts CVPR 2021