conftrace_
← Keywords

knowledge distillation

3725 papers

Explore in graph

Also known as

KD

Co-occurring keywords

model compression (3302) large language model (13587) transfer learning (5449) domain adaptation (4595) representation learning (6206) neural network (6616) language model (4599) catastrophic forgetting (958) continual learning (1181) contrastive learning (4032)

Papers

Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution CVPR 2021
SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud CVPR 2021
Fair Feature Distillation for Visual Recognition CVPR 2021
Language-agnostic Representation from Multilingual Sentence Encoders for Cross-lingual Similarity Estimation EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021
NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021
HW-TSC’s Participation in the WMT 2021 News Translation Shared Task EMNLP 2021
WeChat Neural Machine Translation Systems for WMT21 EMNLP 2021
The Mininglamp Machine Translation System for WMT21 EMNLP 2021
The NiuTrans Machine Translation Systems for WMT21 EMNLP 2021
The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task EMNLP 2021
TenTrans Large-Scale Multilingual Machine Translation System for WMT21 EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Large-Scale Multilingual Translation Task EMNLP 2021
Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
The NiuTrans System for the WMT 2021 Efficiency Task EMNLP 2021
TenTrans High-Performance Inference Toolkit for WMT2021 Efficiency Task EMNLP 2021
Papago’s Submission for the WMT21 Quality Estimation Shared Task EMNLP 2021
Knowledge Distillation with Noisy Labels for Natural Language Understanding EMNLP 2021
SuperMix: Supervising the Mixing Data Augmentation CVPR 2021
Complementary Relation Contrastive Distillation CVPR 2021