Knowledge Distillation

MGAD: Learning Descriptional Representation Distilled from Distributional Semantics for Unseen Entities IJCAI 2022 Mitigating Gender Bias in Distilled Language Models via Counterfactual Role Reversal ACL 2022 MobileFaceSwap: A Lightweight Framework for Video Face Swapping AAAI 2022 Model Compression by Iterative Pruning with Knowledge Distillation and Its Application to Speech Enhancement Interspeech 2022 Model Compression Using Optimal Transport WACV 2022 Model Distillation for Faithful Explanations of Medical Code Predictions ACL 2022 Modular and Parameter-Efficient Fine-Tuning for NLP Models EMNLP 2022 Modularity through Attention: Efficient Training and Transfer of Language-Conditioned Policies for Robot Manipulation CoRL 2022 MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation NAACL 2022 Momentum Adversarial Distillation: Handling Large Distribution Shifts in Data-Free Knowledge Distillation NeurIPS 2022 MonoDistill: Learning Spatial Features for Monocular 3D Object Detection ICLR 2022 MTRec: Multi-Task Learning over BERT for News Recommendation ACL 2022 Multi-Granularity Structural Knowledge Distillation for Language Model Compression ACL 2022 Multi-Knowledge Aggregation and Transfer for Semantic Segmentation AAAI 2022 Multi-Level Branched Regularization for Federated Learning ICML 2022 Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model EMNLP 2022 Multimodal Generation of Radiology Reports using Knowledge-Grounded Extraction of Entities and Relations AACL 2022 Multi-Objective Diverse Human Motion Prediction With Knowledge Distillation CVPR 2022 Multi-Scale Distillation from Multiple Graph Neural Networks AAAI 2022 Multi-stage Distillation Framework for Cross-Lingual Semantic Similarity Matching NAACL 2022 Multi-stage Progressive Compression of Conformer Transducer for On-device Speech Recognition Interspeech 2022 Multi-View Attention Transfer for Efficient Speech Enhancement Interspeech 2022 Muskits: an End-to-end Music Processing Toolkit for Singing Voice Synthesis Interspeech 2022 Named Entity Recognition in Industrial Tables using Tabular Language Models EMNLP 2022 Nearest Neighbor Knowledge Distillation for Neural Machine Translation NAACL 2022