Knowledge Distillation

Modular Transformers: Compressing Transformers into Modularized Layers for Flexible Efficient Inference ACL 2023 Module-wise Adaptive Distillation for Multimodality Foundation Models NeurIPS 2023 MPCFORMER: FAST, PERFORMANT AND PRIVATE TRANSFORMER INFERENCE WITH MPC ICLR 2023 Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling ACL 2023 Multi-Grained Knowledge Retrieval for End-to-End Task-Oriented Dialog ACL 2023 Multi-Head Adapter Routing for Cross-Task Generalization NeurIPS 2023 Multi-Label Knowledge Distillation ICCV 2023 Multi-Level Knowledge Distillation for Out-of-Distribution Detection in Text ACL 2023 Multi-Level Knowledge Distillation for Speech Emotion Recognition in Noisy Conditions Interspeech 2023 Multi-Level Logit Distillation CVPR 2023 Multimedia Generative Script Learning for Task Planning ACL 2023 Multimodal Distillation for Egocentric Action Recognition ICCV 2023 Multimodal Locally Enhanced Transformer for Continuous Sign Language Recognition Interspeech 2023 Multi-mode Neural Speech Coding Based on Deep Generative Networks Interspeech 2023 Multi-Mode Online Knowledge Distillation for Self-Supervised Visual Representation Learning CVPR 2023 Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary Classification EMNLP 2023 Multi-Task Learning with Knowledge Distillation for Dense Prediction ICCV 2023 Multi-teacher Distillation for Multilingual Spelling Correction EMNLP 2023 NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks NeurIPS 2023 NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion ICML 2023 NeRN: Learning Neural Representations for Neural Networks ICLR 2023 NIFF: Alleviating Forgetting in Generalized Few-Shot Object Detection via Neural Instance Feature Forging CVPR 2023 Nkululeko: Machine Learning Experiments on Speaker Characteristics Without Programming Interspeech 2023 NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS Interspeech 2023 NORM: Knowledge Distillation via N-to-One Representation Matching ICLR 2023