conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

ASEM: Enhancing Empathy in Chatbot through Attention-based Sentiment and Emotion Modeling COLING 2024
SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024
Dialogue Summarization with Mixture of Experts based on Large Language Models ACL 2024
Integrating Plutchik’s Theory with Mixture of Experts for Enhancing Emotion Classification EMNLP 2024
FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models EMNLP 2024
Harder Task Needs More Experts: Dynamic Routing in MoE Models ACL 2024
Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices NIPS 2024
Disguise without Disruption: Utility-Preserving Face De-identification AAAI 2024
HDformer: A Higher-Dimensional Transformer for Detecting Diabetes Utilizing Long-Range Vascular Signals AAAI 2024
Mixture of Demonstrations for In-Context Learning NIPS 2024
Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts NIPS 2024
Voice Disorder Analysis: a Transformer-based Approach INTERSPEECH 2024
$\texttt{Model-GLUE}$: Democratized LLM Scaling for A Large Model Zoo in the Wild NIPS 2024
GraphMETRO: Mitigating Complex Graph Distribution Shifts via Mixture of Aligned Experts NIPS 2024
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters CVPR 2024
Mixtures of Experts for Audio-Visual Learning NIPS 2024
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024
Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding COLING 2024
PICSR: Prototype-Informed Cross-Silo Router for Federated Learning (Student Abstract) AAAI 2024
Task-Customized Mixture of Adapters for General Image Fusion CVPR 2024
Parameter-Efficient Sparsity Crafting from Dense to Mixture-of-Experts for Instruction Tuning on General Tasks EMNLP 2024
Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models EMNLP 2024
LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models EMNLP 2024
MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning EMNLP 2024
Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models EMNLP 2024