conftrace_

expert pruning

10 papers

Explore in graph

Co-occurring keywords · papers mentioning both

model compression (8) mixture of expert (7) large language model (3) parameter efficiency (3) knowledge distillation (3) model pruning (2) teacher-student learning (1) activation pattern (1) expert diversity (1) neural network (1)

Papers

CAMERA: Multi-Matrix Joint Compression for MoE Models via Micro-Expert Redundancy Analysis AAAI 2026 Expert Calibration Lens for Pruning Mixture of Experts ACL 2026 DIVE into MoE: Diversity-Enhanced Reconstruction of Large Language Models from Dense into Mixture-of-Experts ACL 2025 Dropping Experts, Recombining Neurons: Retraining-Free Pruning for Sparse Mixture-of-Experts LLMs EMNLP 2025 MoE-I2: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition EMNLP 2024 Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models ACL 2024 SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget ACL 2024 Unraveling Babel: Exploring Multilingual Activation Patterns of LLMs and Their Applications EMNLP 2024 Continual Variational Autoencoder via Continual Generative Knowledge Distillation AAAI 2023 Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model ACL 2023