conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding AAAI 2021
Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Network ACL 2021
Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ACL 2021
Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression EMNLP 2021
How to Select One Among All ? An Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding EMNLP 2021
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation EMNLP 2021
Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation EMNLP 2021
RW-KD: Sample-wise Loss Terms Re-Weighting for Knowledge Distillation EMNLP 2021
MSD: Saliency-aware Knowledge Distillation for Multimodal Understanding EMNLP 2021
GAML-BERT: Improving BERT Early Exiting by Gradient Aligned Mutual Learning EMNLP 2021
Inflate and Shrink:Enriching and Reducing Interactions for Fast Text-Image Retrieval EMNLP 2021
deepQuest-py: Large and Distilled Models for Quality Estimation EMNLP 2021
Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation EMNLP 2021
Semantic Alignment with Calibrated Similarity for Multilingual Sentence Embedding EMNLP 2021
NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021
Distilling Knowledge for Empathy Detection EMNLP 2021
Contrastive Conditioning for Assessing Disambiguation in MT: A Case Study of Distilled Bias EMNLP 2021
N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021
A Peek Into the Reasoning of Neural Networks: Interpreting With Structural Visual Concepts CVPR 2021
Minimally Invasive Surgery for Sparse Neural Networks in Contrastive Manner CVPR 2021
Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation CVPR 2021
On Learning the Geodesic Path for Incremental Learning CVPR 2021
Simulating Unknown Target Models for Query-Efficient Black-Box Attacks CVPR 2021
Data-Free Model Extraction CVPR 2021