knowledge distillation

The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022 The NiuTrans Machine Translation Systems for WMT22 EMNLP 2022 The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models EMNLP 2022 The RoyalFlush System for the WMT 2022 Efficiency Task EMNLP 2022 The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes NeurIPS 2022 The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 ACL 2022 Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation EMNLP 2022 TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation NeurIPS 2022 Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022 Towards Data-Free Domain Generalization ACML 2022 Towards Data-Free Model Stealing in a Hard Label Setting CVPR 2022 Towards Efficient 3D Object Detection with Knowledge Distillation NeurIPS 2022 Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation ACL 2022 Towards Model Agnostic Federated Learning Using Knowledge Distillation ICLR 2022 Toward Understanding Privileged Features Distillation in Learning-to-Rank NeurIPS 2022 Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models EMNLP 2022 Training Spiking Neural Networks with Local Tandem Learning NeurIPS 2022 TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition EMNLP 2022 Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations ICLR 2022 Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing COLING 2022 Transferring Pre-trained Multimodal Representations with Cross-modal Similarity Matching NeurIPS 2022 Transn’s Submissions to the WMT22 Translation Suggestion Task EMNLP 2022 TRILLsson: Distilled Universal Paralinguistic Speech Representations Interspeech 2022 TrustAL: Trustworthy Active Learning Using Knowledge Distillation AAAI 2022 TSPipe: Learn from Teacher Faster with Pipelines ICML 2022