conftrace_

sparse architecture

11 papers

Explore in graph

Co-occurring keywords · papers mentioning both

mixture of expert (5) large language model (2) expert specialization (2) sparse model (2) network pruning (2) neural machine translation (2) multilingual translation (2) model compression (2) token routing (1) modular neural network (1)

Papers

Decoding Knowledge Attribution in Mixture-of-Experts: A Framework of Basic-Refinement Collaboration and Efficiency Analysis ACL 2025 Mixture of Hidden-Dimensions: Not All Hidden-States’ Dimensions are Needed in Transformer ICML 2025 MoEP: Modular Expert Paths for Sample-Efficient Language Modeling EMNLP 2025 Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models EMNLP 2024 Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models ICLR 2024 MMNMT: Modularizing Multilingual Neural Machine Translation with Flexibly Assembled MoE and Dense Blocks EMNLP 2023 Is a Modular Architecture Enough? NeurIPS 2022 Tricks for Training Sparse Translation Models NAACL 2022 Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning ICLR 2021 Robust Pruning at Initialization ICLR 2021 Scaling Vision with Sparse Mixture of Experts NeurIPS 2021