Knowledge Distillation

Multilingual Neural Machine Translation: Can Linguistic Hierarchies Help? EMNLP 2021 Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition AAAI 2021 Multiresolution Knowledge Distillation for Anomaly Detection CVPR 2021 Multi-Scale Aligned Distillation for Low-Resolution Detection CVPR 2021 Mutual-Learning Improves End-to-End Speech Translation EMNLP 2021 NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application EMNLP 2021 N-LTP: An Open-source Neural Language Technology Platform for Chinese EMNLP 2021 Novel Visual Category Discovery with Dual Ranking Statistics and Mutual Knowledge Distillation NeurIPS 2021 NVIDIA NeMo’s Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 EMNLP 2021 Obtaining Better Static Word Embeddings Using Contextual Embedding Models ACL 2021 On Learning the Geodesic Path for Incremental Learning CVPR 2021 Online Multi-Granularity Distillation for GAN Compression ICCV 2021 Parser-Free Virtual Try-On via Distilling Appearance Flows CVPR 2021 PDALN: Progressive Domain Adaptation over a Pre-trained Model for Low-Resource Cross-Domain Named Entity Recognition EMNLP 2021 Peer Collaborative Learning for Online Knowledge Distillation AAAI 2021 PLOP: Learning Without Forgetting for Continual Semantic Segmentation CVPR 2021 Positive-Unlabeled Data Purification in the Wild for Object Detection CVPR 2021 PQK: Model Compression via Pruning, Quantization, and Knowledge Distillation Interspeech 2021 PR-Net: Preference Reasoning for Personalized Video Highlight Detection ICCV 2021 Probabilistic Model Distillation for Semantic Correspondence CVPR 2021 Progressive Network Grafting for Few-Shot Knowledge Distillation AAAI 2021 PSSM-Distil: Protein Secondary Structure Prediction (PSSP) on Low-Quality PSSM by Knowledge Distillation with Contrastive Learning AAAI 2021 RankDistil: Knowledge Distillation for Ranking AISTATS 2021 Real-Time Video Inference on Edge Devices via Adaptive Model Streaming ICCV 2021 Refine Myself by Teaching Myself: Feature Refinement via Self-Knowledge Distillation CVPR 2021