conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024
SC-MoE: Switch Conformer Mixture of Experts for Unified Streaming and Non-streaming Code-Switching ASR INTERSPEECH 2024
Effective High-order Graph Representation Learning for Credit Card Fraud Detection IJCAI 2024
Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters INTERSPEECH 2024
Werkzeug at SemEval-2024 Task 8: LLM-Generated Text Detection via Gated Mixture-of-Experts Fine-Tuning NAACL 2024
What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection ACL 2024
Exploring Domain Robust Lightweight Reward Models based on Router Mechanism ACL 2024
Turn Waste into Worth: Rectifying Top-k Router of MoE EMNLP 2024
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs EMNLP 2024
Mixture of Diverse Size Experts EMNLP 2024
AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models EMNLP 2024
Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models EMNLP 2024
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE AAAI 2024
Toward Efficient Inference for Mixture of Experts NIPS 2024
Combining Multiple Metrics for Evaluating Retrieval-Augmented Conversations NAACL 2024
Memory Augmented Language Models through Mixture of Word Experts NAACL 2024
Enhancing Robustness of Graph Neural Networks on Social Media with Explainable Inverse Reinforcement Learning NIPS 2024
Frequency-Adaptive Pan-Sharpening with Mixture of Experts AAAI 2024
Uni-Med: A Unified Medical Generalist Foundation Model For Multi-Task Learning Via Connector-MoE NIPS 2024
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts ACL 2024
Two Heads are Better than One: Nested PoE for Robust Defense Against Multi-Backdoors NAACL 2024
MoPE: Mixture of Prefix Experts for Zero-Shot Dialogue State Tracking COLING 2024
Generator Assisted Mixture of Experts for Feature Acquisition in Batch AAAI 2024
Event Representation Learning with Multi-Grained Contrastive Learning and Triple-Mixture of Experts COLING 2024
EpLSA: Synergy of Expert-prefix Mixtures and Task-Oriented Latent Space Adaptation for Diverse Generative Reasoning COLING 2024