knowledge distillation

Slimmable Domain Adaptation CVPR 2022 SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation EMNLP 2022 Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection NeurIPS 2022 Sparse Distillation: Speeding Up Text Classification by Using Bigger Student Models NAACL 2022 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT EMNLP 2022 Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm ACL 2022 Sparse Teachers Can Be Dense with Knowledge EMNLP 2022 Spatial-Channel Token Distillation for Vision MLPs ICML 2022 Speech Emotion: Investigating Model Representations, Multi-Task Learning and Knowledge Distillation Interspeech 2022 Static-Dynamic Co-teaching for Class-Incremental 3D Object Detection AAAI 2022 Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing NeurIPS 2022 Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation CVPR 2022 Structural Knowledge Distillation for Object Detection NeurIPS 2022 Structural Pruning via Latency-Saliency Knapsack NeurIPS 2022 Structured Pruning Learns Compact and Accurate Models ACL 2022 Structured Sparse R-CNN for Direct Scene Graph Generation CVPR 2022 Student Surpasses Teacher: Imitation Attack for Black-Box NLP APIs COLING 2022 SubeventWriter: Iterative Sub-event Sequence Generation with Coherence Controller EMNLP 2022 Supervised Compression for Resource-Constrained Edge Computing Systems WACV 2022 Symbolic Distillation for Learned TCP Congestion Control NeurIPS 2022 Symbolic Knowledge Distillation: from General Language Models to Commonsense Models NAACL 2022 TAKE: Topic-shift Aware Knowledge sElection for Dialogue Generation COLING 2022 Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection CVPR 2022 Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation NeurIPS 2022 The AISP-SJTU Translation System for WMT 2022 EMNLP 2022