conftrace_

expert specialization

33 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (22) parameter efficiency (6) model compression (6) knowledge distillation (5) expert routing (4) large language model (4) neural network (4) instruction tuning (3) model architecture (3) load balancing (2)

Papers

Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Rendering ECCV 2024 DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models ACL 2024 Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models EMNLP 2024 MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts AAAI 2024 Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NeurIPS 2024 Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners CVPR 2023 Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers ICLR 2023 Learning a Mixture of Granularity-Specific Experts for Fine-Grained Categorization ICCV 2019