← Keywords

knowledge distillation

3680 papers

Explore in graph

Also known as

CD DMD LORA KL DNA SELF-DISTILLATION TKD NBOD AD KD AOTD KI GID FD MKD SEQKD

Co-occurring keywords

model compression (3283) large language model (12755) transfer learning (5442) domain adaptation (4578) representation learning (6174) neural network (6616) language model (4573) continual learning (1164) catastrophic forgetting (939) contrastive learning (3979)

Papers

More Photos Are All You Need: Semi-Supervised Learning for Fine-Grained Sketch Based Image Retrieval CVPR 2021
A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification CVPR 2021
Unsupervised Real-World Image Super Resolution via Domain-Distance Aware Training CVPR 2021
Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021
General Instance Distillation for Object Detection CVPR 2021
Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolution CVPR 2021
SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud CVPR 2021
Fair Feature Distillation for Visual Recognition CVPR 2021
Language-agnostic Representation from Multilingual Sentence Encoders for Cross-lingual Similarity Estimation EMNLP 2021
AUTOSUMM: Automatic Model Creation for Text Summarization EMNLP 2021
Limitations of Knowledge Distillation for Zero-shot Transfer Learning EMNLP 2021
Distiller: A Systematic Study of Model Distillation Methods in Natural Language Processing EMNLP 2021
Shrinking Bigfoot: Reducing wav2vec 2.0 footprint EMNLP 2021
Ensembling of Distilled Models from Multi-task Teachers for Constrained Resource Language Pairs EMNLP 2021
NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021
HW-TSC’s Participation in the WMT 2021 News Translation Shared Task EMNLP 2021
WeChat Neural Machine Translation Systems for WMT21 EMNLP 2021
The Mininglamp Machine Translation System for WMT21 EMNLP 2021
The NiuTrans Machine Translation Systems for WMT21 EMNLP 2021
The LMU Munich System for the WMT 2021 Large-Scale Multilingual Machine Translation Shared Task EMNLP 2021
TenTrans Large-Scale Multilingual Machine Translation System for WMT21 EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Large-Scale Multilingual Translation Task EMNLP 2021
Efficient Machine Translation with Model Pruning and Quantization EMNLP 2021
HW-TSC’s Participation in the WMT 2021 Efficiency Shared Task EMNLP 2021
The NiuTrans System for the WMT 2021 Efficiency Task EMNLP 2021