Knowledge Distillation

Nested Collaborative Learning for Long-Tailed Visual Recognition CVPR 2022 OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework ICML 2022 Offline Multi-Agent Reinforcement Learning with Knowledge Distillation NeurIPS 2022 One Reference Is Not Enough: Diverse Distillation with Reference Selection for Non-Autoregressive Translation NAACL 2022 One-Teacher and Multiple-Student Knowledge Distillation on Sentiment Classification COLING 2022 Online Knowledge Distillation by Temporal-Spatial Boosting WACV 2022 Opencpop: A High-Quality Open Source Chinese Popular Song Corpus for Singing Voice Synthesis Interspeech 2022 Open-vocabulary Object Detection via Vision and Language Knowledge Distillation ICLR 2022 Open-Vocabulary One-Stage Detection With Hierarchical Visual-Language Knowledge Distillation CVPR 2022 Outsourcing Training without Uploading Data via Efficient Collaborative Open-Source Sampling NeurIPS 2022 Overcoming Catastrophic Forgetting beyond Continual Learning: Balanced Training for Neural Machine Translation ACL 2022 Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation CVPR 2022 Parameter-Efficient Abstractive Question Answering over Tables or Text ACL 2022 Parameter Efficient Transfer Learning for Suicide Attempt and Ideation Detection EMNLP 2022 Partially-Random Initialization: A Smoking Gun for Binarization Hypothesis of BERT EMNLP 2022 PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Models CVPR 2022 PERF-Net: Pose Empowered RGB-Flow Net WACV 2022 Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search CVPR 2022 Performance-Efficiency Trade-Offs in Adapting Language Models to Text Classification Tasks AACL 2022 PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation EMNLP 2022 PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficient NeurIPS 2022 Plug and Play Knowledge Distillation for kNN-LM with External Logits AACL 2022 Point-to-Voxel Knowledge Distillation for LiDAR Semantic Segmentation CVPR 2022 Post-Training with Interrogative Sentences for Enhancing BART-based Korean Question Generator AACL 2022 PPCD-GAN: Progressive Pruning and Class-Aware Distillation for Large-Scale Conditional GANs Compression WACV 2022