Knowledge Distillation

STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing EMNLP 2022 Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NeurIPS 2022 Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation CVPR 2022 Structural Knowledge Distillation for Object Detection NeurIPS 2022 Structured Pruning Learns Compact and Accurate Models ACL 2022 Supervised Compression for Resource-Constrained Edge Computing Systems WACV 2022 Symbolic Distillation for Learned TCP Congestion Control NeurIPS 2022 Symbolic Knowledge Distillation: from General Language Models to Commonsense Models NAACL 2022 TAKE: Topic-shift Aware Knowledge sElection for Dialogue Generation COLING 2022 Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NeurIPS 2022 The AISP-SJTU Translation System for WMT 2022 EMNLP 2022 The Effectiveness of Masked Language Modeling and Adapters for Factual Knowledge Injection COLING 2022 The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains EMNLP 2022 The Unreasonable Effectiveness of Fully-Connected Layers for Low-Data Regimes NeurIPS 2022 The Xiaomi Text-to-Text Simultaneous Speech Translation System for IWSLT 2022 ACL 2022 Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation EMNLP 2022 TOIST: Task Oriented Instance Segmentation Transformer with Noun-Pronoun Distillation NeurIPS 2022 Too Brittle to Touch: Comparing the Stability of Quantization and Distillation towards Developing Low-Resource MT Models EMNLP 2022 Towards Data-Free Domain Generalization ACML 2022 Towards Efficient 3D Object Detection with Knowledge Distillation NeurIPS 2022 Towards Model Agnostic Federated Learning Using Knowledge Distillation ICLR 2022 Toward Understanding Privileged Features Distillation in Learning-to-Rank NeurIPS 2022 Training Spiking Neural Networks with Local Tandem Learning NeurIPS 2022 TransAdv: A Translation-based Adversarial Learning Framework for Zero-Resource Cross-Lingual Named Entity Recognition EMNLP 2022 Transferring Knowledge from Structure-aware Self-attention Language Model to Sequence-to-Sequence Semantic Parsing COLING 2022