knowledge distillation

Local-Global Multi-Modal Distillation for Weakly-Supervised Temporal Video Grounding AAAI 2024 LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models ACL 2024 Logit Standardization in Knowledge Distillation CVPR 2024 LoRAExit: Empowering Dynamic Modulation of LLMs in Resource-limited Settings using Low-rank Adapters EMNLP 2024 LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models EMNLP 2024 Low-Complexity Acoustic Scene Classification Using Parallel Attention-Convolution Network Interspeech 2024 LP-OVOD: Open-Vocabulary Object Detection by Linear Probing WACV 2024 LSTKC: Long Short-Term Knowledge Consolidation for Lifelong Person Re-identification AAAI 2024 M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation ACL 2024 MadEye: Boosting Live Video Analytics Accuracy with Adaptive Camera Configurations NSDI 2024 Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation ECCV 2024 Make Graph Neural Networks Great Again: A Generic Integration Paradigm of Topology-Free Patterns for Traffic Speed Prediction IJCAI 2024 Markov Knowledge Distillation: Make Nasty Teachers trained by Self-undermining Knowledge Distillation Fully Distillable ECCV 2024 Masked Distillation Advances Self-Supervised Transformer Architecture Search ICLR 2024 MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods ICLR 2024 MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval NAACL 2024 MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning ACL 2024 MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification EMNLP 2024 MEND: Meta Demonstration Distillation for Efficient and Effective In-Context Learning ICLR 2024 Mentor-KD: Making Small Language Models Better Multi-step Reasoners EMNLP 2024 Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy ICLR 2024 Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging EMNLP 2024 MGCL: Multi-Granularity Clue Learning for Emotion-Cause Pair Extraction via Cross-Grained Knowledge Distillation EMNLP 2024 MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis ICML 2024 MIND: Multimodal Shopping Intention Distillation from Large Vision-language Models for E-commerce Purchase Understanding EMNLP 2024