knowledge distillation

Tutoring Helps Students Learn Better: Improving Knowledge Distillation for BERT with Tutor Network EMNLP 2022 TVT: Three-Way Vision Transformer through Multi-Modal Hypersphere Learning for Zero-Shot Sketch-Based Image Retrieval AAAI 2022 UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation IJCAI 2022 Uncertainty-Aware Hierarchical Refinement for Incremental Implicitly-Refined Classification NeurIPS 2022 Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022 Unified Visual Transformer Compression ICLR 2022 Unifying the Convergences in Multilingual Neural Machine Translation EMNLP 2022 UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation AAAI 2022 Unsupervised Domain Adaptation for Sparse Retrieval by Filling Vocabulary and Word Frequency Gaps AACL 2022 Unsupervised Representation Learning for Binary Networks by Joint Classifier Learning CVPR 2022 Up to 100x Faster Data-Free Knowledge Distillation AAAI 2022 Using time-series privileged information for provably efficient learning of prediction models AISTATS 2022 VIRT: Improving Representation-based Text Matching via Virtual Interaction EMNLP 2022 ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation NeurIPS 2022 Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation CVPR 2022 Weak-shot Semantic Segmentation via Dual Similarity Transfer NeurIPS 2022 Weighted Distillation with Unlabeled Examples NeurIPS 2022 Weighted Mutual Learning with Diversity-Driven Model Compression NeurIPS 2022 What Do Compressed Multilingual Machine Translation Models Forget? EMNLP 2022 What Makes a "Good" Data Augmentation in Knowledge Distillation - A Statistical Perspective NeurIPS 2022 When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentation ACL 2022 When the Student Becomes the Master: Learning Better and Smaller Monolingual Models from mBERT COLING 2022 Why Knowledge Distillation Amplifies Gender Bias and How to Mitigate from the Perspective of DistilBERT NAACL 2022 Wider & Closer: Mixture of Short-channel Distillers for Zero-shot Cross-lingual Named Entity Recognition EMNLP 2022 XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding ACL 2022