sparse activation

Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis ACL 2026 Is Parameter Isolation Better for Prompt-Based Continual Learning? CVPR 2026 OneSparse: A Unified Framework for Sparse Activation Layers in Vision Models CVPR 2026 Scene Experts: Specializing in 3D Gaussian Splatting with Adaptive Decomposition AAAI 2026 Sparse Checkpointing for Fast and Reliable MoE Training NSDI 2026 SYMI: Efficient Mixture-of-Experts Training via Model and Optimizer State Decoupling NSDI 2026 UniMMAD: Unified Multi-Modal and Multi-Class Anomaly Detection via MoE-Driven Feature Decompression CVPR 2026 A Closer Look into Mixture-of-Experts in Large Language Models NAACL 2025 COUNTDOWN: Contextually Sparse Activation Filtering Out Unnecessary Weights in Down Projection EMNLP 2025 DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs EMNLP 2025 Efficient Data Driven Mixture-of-Expert Extraction from Trained Networks CVPR 2025 Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis CVPR 2025 Intrinsic User-Centric Interpretability through Global Mixture of Experts ICLR 2025 Maximum Score Routing For Mixture-of-Experts ACL 2025 Mixture of Experts Made Intrinsically Interpretable ICML 2025 Mixture of Languages: Improved Multilingual Encoders Through Language Grouping EMNLP 2025 MoEQuant: Enhancing Quantization for Mixture-of-Experts Large Language Models via Expert-Balanced Sampling and Affinity Guidance ICML 2025 ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing ICLR 2025 Semantic Aware Representation Learning for Lifelong Learning ICLR 2025 SMoSE: Sparse Mixture of Shallow Experts for Interpretable Reinforcement Learning in Continuous Control Tasks AAAI 2025 SoLA: Leveraging Soft Activation Sparsity and Low-Rank Decomposition for Large Language Model Compression AAAI 2025 Sparse Activation Editing for Reliable Instruction Following in Narratives EMNLP 2025 Sparse Activations as Conformal Predictors AISTATS 2025 Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts ICLR 2025 Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024