Determining Layer-wise Sparsity for Large Language Models Through a Theoretical Perspective

Weizhong Huang; Yuxin Zhang; Xiawu Zheng; Fei Chao; Rongrong Ji

2025 ICML ICML 2025

Determining Layer-wise Sparsity for Large Language Models Through a Theoretical Perspective

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Weizhong Huang, Yuxin Zhang, Xiawu Zheng, Fei Chao, Rongrong Ji

Topics

Machine Learning > Optimization & Theory > Optimization Machine Learning > Application Areas > Efficient Computing Artificial Intelligence > Core AI > Large Language Models

Keywords

zero-shot accuracy arithmetic progression perplexity reconstruction error explosion sparsity rates speedups

Download PDF