knowledge distillation

MemSR: Training Memory-efficient Lightweight Model for Image Super-Resolution ICML 2022 Meta-DMoE: Adapting to Domain Shift by Meta-Distillation from Mixture-of-Experts NeurIPS 2022 Meta-Learning Adaptive Knowledge Distillation for Efficient Biomedical Natural Language Processing AACL 2022 Meta-Learning with Self-Improving Momentum Target NeurIPS 2022 Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning EMNLP 2022 MGAD: Learning Descriptional Representation Distilled from Distributional Semantics for Unseen Entities IJCAI 2022 Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning CVPR 2022 MiniViT: Compressing Vision Transformers With Weight Multiplexing CVPR 2022 Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022 MobileFaceSwap: A Lightweight Framework for Video Face Swapping AAAI 2022 Model Compression by Iterative Pruning with Knowledge Distillation and Its Application to Speech Enhancement Interspeech 2022 Model Compression Using Optimal Transport WACV 2022 Model Distillation for Faithful Explanations of Medical Code Predictions ACL 2022 Modeling Document-level Temporal Structures for Building Temporal Dependency Graphs AACL 2022 MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022 Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation NeurIPS 2022 MonoDistill: Learning Spatial Features for Monocular 3D Object Detection ICLR 2022 MTGLS: Multi-Task Gaze Estimation With Limited Supervision WACV 2022 Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022 Multi-Knowledge Aggregation and Transfer for Semantic Segmentation AAAI 2022 Multi-Level Branched Regularization for Federated Learning ICML 2022 Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model EMNLP 2022 Multi-Modal Alignment Using Representation Codebook CVPR 2022 Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation CVPR 2022 Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022