knowledge distillation

MIND: Multi-Task Incremental Network Distillation AAAI 2024 Mind’s Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models NAACL 2024 MiniLLM: Knowledge Distillation of Large Language Models ICLR 2024 Minimal Distillation Schedule for Extreme Language Model Compression EACL 2024 MinT: Boosting Generalization in Mathematical Reasoning via Multi-view Fine-tuning COLING 2024 Mirage: Model-agnostic Graph Distillation for Graph Classification ICLR 2024 MISA: MIning Saliency-Aware Semantic Prior for Box Supervised Instance Segmentation IJCAI 2024 Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation WACV 2024 Mitigating Overfitting in Structured Pruning of ASR Models with Gradient-Guided Parameter Regularization Interspeech 2024 Mixed Distillation Helps Smaller Language Models Reason Better EMNLP 2024 MLIP: Enhancing Medical Visual Representation with Divergence Encoder and Knowledge-guided Contrastive Learning CVPR 2024 MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training CVPR 2024 MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024 MoDE-CoTD: Chain-of-Thought Distillation for Complex Reasoning Tasks with Mixture of Decoupled LoRA-Experts COLING 2024 Model LEGO: Creating Models Like Disassembling and Assembling Building Blocks NeurIPS 2024 MolTRES: Improving Chemical Language Representation Learning for Molecular Property Prediction EMNLP 2024 MoPE-CLIP: Structured Pruning for Efficient Vision-Language Models with Module-wise Pruning Error Metric CVPR 2024 MTA4DPR: Multi-Teaching-Assistants Based Iterative Knowledge Distillation for Dense Passage Retrieval EMNLP 2024 MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translation NAACL 2024 Multi-Expert Distillation for Few-Shot Coordination (Student Abstract) AAAI 2024 Multilingual Brain Surgeon: Large Language Models Can Be Compressed Leaving No Language behind COLING 2024 Multimodal Machine Translation for Low-Resource Indic Languages: A Chain-of-Thought Approach Using Large Language Models EMNLP 2024 Multiple Sources are Better Than One: Incorporating External Knowledge in Low-Resource Glossing EMNLP 2024 Multi-Stage Balanced Distillation: Addressing Long-Tail Challenges in Sequence-Level Knowledge Distillation EMNLP 2024 Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation ACL 2024