conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model With Knowledge-Enhanced Mixture-of-Denoising-Experts CVPR 2023
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations ACL 2023
Hybrid CNN-Transformer Feature Fusion for Single Image Deraining AAAI 2023
ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labels AAAI 2023
Multi-Modal Gated Mixture of Local-to-Global Experts for Dynamic Image Fusion ICCV 2023
MixPHM: Redundancy-Aware Parameter-Efficient Tuning for Low-Resource Visual Question Answering CVPR 2023
RepMode: Learning to Re-Parameterize Diverse Experts for Subcellular Structure Prediction CVPR 2023
Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wild CVPR 2023
Learning a Sparse Transformer Network for Effective Image Deraining CVPR 2023
TJUNLP:System Description for the WMT23 Literary Task in Chinese to English Translation Direction EMNLP 2023
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding EMNLP 2023
Scaling Vision-Language Models with Sparse Mixture of Experts EMNLP 2023
Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models EMNLP 2023
Getting MoRE out of Mixture of Language Model Reasoning Experts EMNLP 2023
Manifold-Preserving Transformers are Effective for Short-Long Range Encoding EMNLP 2023
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer NIPS 2023
DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets NIPS 2023
RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths NIPS 2023
Bidirectional Attention as a Mixture of Continuous Word Experts UAI 2023
Bootstrapping Multi-View Representations for Fake News Detection AAAI 2023
Conversational Emotion-Cause Pair Extraction with Guided Mixture of Experts EACL 2023
A Survey on Dynamic Neural Networks for Natural Language Processing EACL 2023
Dynamic Mixture of Counter Network for Location-Agnostic Crowd Counting WACV 2023
Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks ICML 2023
Lifelong Language Pretraining with Distribution-Specialized Experts ICML 2023