knowledge distillation

UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers ICML 2023 USTC-NELSLIP at SemEval-2023 Task 2: Statistical Construction and Dual Adaptation of Gazetteer for Multilingual Complex NER SemEval 2023 Vertical Federated Graph Neural Network for Recommender System ICML 2023 Visual-Language Prompt Tuning With Knowledge-Guided Context Optimization CVPR 2023 Weakly Supervised 3D Open-vocabulary Segmentation NeurIPS 2023 Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning ICLR 2023 Weak-Shot Object Detection Through Mutual Knowledge Transfer CVPR 2023 What Can we Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers? ICLR 2023 What Knowledge Gets Distilled in Knowledge Distillation? NeurIPS 2023 When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario ACL 2023 When Prompt-based Incremental Learning Does Not Meet Strong Pretraining ICCV 2023 Whole-slide-imaging Cancer Metastases Detection and Localization with Limited Tumorous Data MIDL 2023 X3KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection CVPR 2023 You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models EACL 2023 ZipLM: Inference-Aware Structured Pruning of Language Models NeurIPS 2023 Accelerating Inference for Pretrained Language Models by Unified Multi-Perspective Early Exiting COLING 2022 Acceleration of Federated Learning with Alleviated Forgetting in Local Training ICLR 2022 A Closer Look at Parameter Contributions When Training Neural Language and Translation Models COLING 2022 AdaPrompt: Adaptive Model Training for Prompt-based NLP EMNLP 2022 Adaptive Label Smoothing with Self-Knowledge in Natural Language Generation EMNLP 2022 ADD: Frequency Attention and Multi-View Based Knowledge Distillation to Detect Low-Quality Compressed Deepfake Images AAAI 2022 Adversarial Data Augmentation for Task-Specific Knowledge Distillation of Pre-trained Transformers AAAI 2022 Adversarial Knowledge Distillation For Robust Spoken Language Understanding Interspeech 2022 A Fast Post-Training Pruning Framework for Transformers NeurIPS 2022 A Flexible Multi-Task Model for BERT Serving ACL 2022