conftrace_

mixture of expert

640 papers

Explore in graph

Also known as

MOE

Co-occurring keywords

large language model (13587) model compression (3302) multi-task learning (2575) multimodal learning (4645) neural network (6616) knowledge distillation (3725) low-rank adaptation (560) parameter efficiency (417) transfer learning (5449) expert routing (44)

Papers

Mixtures of Gaussian Process Experts with SMC^2 JMLR 2025
Automatic Expert Discovery in LLM Upcycling via Sparse Interpolated Mixture-of-Experts ACL 2025
Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models ACL 2025
FoldMoE: Efficient Long Sequence MoE Training via Attention-MoE Pipelining ACL 2025
Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Dataset CVPR 2025
Correlative and Discriminative Label Grouping for Multi-Label Visual Prompt Tuning CVPR 2025
SPMTrack: Spatio-Temporal Parameter-Efficient Fine-Tuning with Mixture of Experts for Scalable Visual Tracking CVPR 2025
Efficient Data Driven Mixture-of-Expert Extraction from Trained Networks CVPR 2025
Probing Semantic Routing in Large Mixture-of-Expert Models EMNLP 2025
MExD: An Expert-Infused Diffusion Model for Whole-Slide Image Classification CVPR 2025
LiMoE: Mixture of LiDAR Representation Learners from Automotive Scenes CVPR 2025
Disentangling Multi-view Representations via Curriculum Learning with Learnable Prior IJCAI 2025
Enhancing Talent Search Ranking with Role-Aware Expert Mixtures and LLM-based Fine-Grained Job Descriptions EMNLP 2025
BTW: A Non-Parametric Variance Stabilization Framework for Multimodal Model Integration EMNLP 2025
LoRACoE: Improving Large Language Model via Composition-based LoRA Expert EMNLP 2025
Complexity Experts are Task-Discriminative Learners for Any Image Restoration CVPR 2025
Too Helpful, Too Harmless, Too Honest or Just Right? EMNLP 2025
Mixture of Languages: Improved Multilingual Encoders Through Language Grouping EMNLP 2025
Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing ACL 2025
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization EMNLP 2025
DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs EMNLP 2025
SimSMoE: Toward Efficient Training Mixture of Experts via Solving Representational Collapse NAACL 2025
Enhancing Speech Large Language Models with Prompt-Aware Mixture of Audio Encoders EMNLP 2025
Mixture-of-Clustered-Experts: Advancing Expert Specialization and Generalization in Instruction Tuning EMNLP 2025
Connector-S: A Survey of Connectors in Multi-modal Large Language Models IJCAI 2025