conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Enhancing Diversity in Teacher-Student Networks via Asymmetric Branches for Unsupervised Person Re-Identification WACV 2021
Training Binary Neural Network without Batch Normalization for Image Super-Resolution AAAI 2021
Semi-Supervised Knowledge Amalgamation for Sequence Classification AAAI 2021
Membership Privacy for Machine Learning Models Through Knowledge Transfer AAAI 2021
Introspective Distillation for Robust Question Answering NIPS 2021
Unleash GPT-2 Power for Event Detection ACL 2021
SSUL: Semantic Segmentation with Unknown Label for Exemplar-based Class-Incremental Learning NIPS 2021
BinaryBERT: Pushing the Limit of BERT Quantization ACL 2021
Improving Speech Translation by Understanding and Learning from the Auxiliary Text Translation Task ACL 2021
Self-Distillation for Few-Shot Image Captioning WACV 2021
Grounding Consistency: Distilling Spatial Common Sense for Precise Visual Relationship Detection ICCV 2021
G-DetKD: Towards General Distillation Framework for Object Detectors via Contrastive and Semantic-Guided Feature Imitation ICCV 2021
SIGN: Spatial-Information Incorporated Generative Network for Generalized Zero-Shot Semantic Segmentation ICCV 2021
Text Is Text, No Matter What: Unifying Text Recognition Using Knowledge Distillation ICCV 2021
Reasoning Visual Dialog with Sparse Graph Learning and Knowledge Transfer EMNLP 2021
Jointly Learning to Repair Code and Generate Commit Message EMNLP 2021
Multilingual AMR Parsing with Noisy Knowledge Distillation EMNLP 2021
Unpaired Learning for Deep Image Deraining With Rain Direction Regularizer ICCV 2021
Dynamic Knowledge Distillation for Pre-trained Language Models EMNLP 2021
Improving Stance Detection with Multi-Dataset Learning and Knowledge Distillation EMNLP 2021
Collaborative Learning of Bidirectional Decoders for Unsupervised Text Style Transfer EMNLP 2021
Finetuning Pretrained Transformers into RNNs EMNLP 2021
LMdiff: A Visual Diff Tool to Compare Language Models EMNLP 2021
CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade EMNLP 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021