Knowledge Distillation

Learning Multiple Adverse Weather Removal via Two-Stage Knowledge Learning and Multi-Contrastive Regularization: Toward a Unified Model CVPR 2022 Learning to Generate Question by Asking Question: A Primal-Dual Approach with Uncommon Word Generation EMNLP 2022 Learning to Scaffold: Optimizing Model Explanations for Teaching NeurIPS 2022 Learn What Is Possible, Then Choose What Is Best: Disentangling One-To-Many Relations in Language Through Text-based Games EMNLP 2022 Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models EMNLP 2022 Let Images Give You More: Point Cloud Cross-Modal Training for Shape Analysis NeurIPS 2022 LGD: Label-Guided Self-Distillation for Object Detection AAAI 2022 LM-CORE: Language Models with Contextually Relevant External Knowledge NAACL 2022 Localization Distillation for Dense Object Detection CVPR 2022 Long-Tail Recognition via Compositional Knowledge Transfer CVPR 2022 Look Around and Refer: 2D Synthetic Semantics Knowledge Distillation for 3D Visual Grounding NeurIPS 2022 Lost in Distillation: A Case Study in Toxicity Modeling NAACL 2022 Low-Cost Multispectral Scene Analysis With Modality Distillation WACV 2022 Low Resource Causal Event Detection from Biomedical Literature ACL 2022 Low-resource Low-footprint Wake-word Detection using Knowledge Distillation Interspeech 2022 MAgNet: Mesh Agnostic Neural PDE Solver NeurIPS 2022 Maximum Bayes Smatch Ensemble Distillation for AMR Parsing NAACL 2022 Measuring and Reducing Model Update Regression in Structured Prediction for NLP NeurIPS 2022 Memory Efficient Continual Learning with Transformers NeurIPS 2022 MemSR: Training Memory-efficient Lightweight Model for Image Super-Resolution ICML 2022 Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NeurIPS 2022 META-GUI: Towards Multi-modal Conversational Agents on Mobile GUI EMNLP 2022 Meta-Learning Adaptive Knowledge Distillation for Efficient Biomedical Natural Language Processing AACL 2022 Meta-Learning with Self-Improving Momentum Target NeurIPS 2022 Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning EMNLP 2022