conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Mixtures of Controlled Gaussian Processes for Dynamical Modeling of Deformable Objects L4DC 2022
LUL’s WMT22 Automatic Post-Editing Shared Task Submission EMNLP 2022
Named Entity and Relation Extraction with Multi-Modal Retrieval EMNLP 2022
Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context Experts EMNLP 2022
MoEfication: Transformer Feed-forward Layers are Mixtures of Experts ACL 2022
RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling AAAI 2022
Table-based Fact Verification with Self-adaptive Mixture of Experts ACL 2022
Scaling Vision with Sparse Mixture of Experts NIPS 2021
Specializing Versatile Skill Libraries using Local Mixture of Experts CORL 2021
Contextual policy transfer in reinforcement learning domains via deep mixtures-of-experts UAI 2021
Cross-Topic Rumor Detection using Topic-Mixtures EACL 2021
Strength in Numbers: Averaging and Clustering Effects in Mixture of Experts for Graph-Based Dependency Parsing IJCNLP 2021
A Mixture-of-Experts Model for Antonym-Synonym Discrimination IJCNLP 2021
Hash Layers For Large Sparse Models NIPS 2021
Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks CVPR 2021
Simple or Complex? Complexity-controllable Question Generation with Soft Templates and Deep Mixture of Experts Model EMNLP 2021
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference EMNLP 2021
Improving Robustness Against Common Corruptions With Frequency Biased Models ICCV 2021
Universal Simultaneous Machine Translation with Mixture-of-Experts Wait-k Policy EMNLP 2021
A Mixture-of-Experts Model for Antonym-Synonym Discrimination ACL 2021
AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding ACL 2021
Strength in Numbers: Averaging and Clustering Effects in Mixture of Experts for Graph-Based Dependency Parsing ACL 2021
SpeechMoE: Scaling to Large Acoustic Models with Dynamic Routing Mixture of Experts INTERSPEECH 2021
On Component Interactions in Two-Stage Recommender Systems NIPS 2021
GEMNET: Effective Gated Gazetteer Representations for Recognizing Complex Entities in Low-context Input NAACL 2021