Co-occurring keywords
Papers
DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs
EMNLP 2025
Building on Efficient Foundations: Effective Training of LLMs with Structured Feedforward Layers
NIPS 2024
Counter-Current Learning: A Biologically Plausible Dual Network Approach for Deep Learning
NIPS 2024
One Wide Feedforward Is All You Need
EMNLP 2023