Compressing Large Language Models by Joint Sparsification and Quantization

Jinyang Guo; Jianyu Wu; Zining Wang; Jiaheng Liu; Ge Yang; Yifu Ding; Ruihao Gong; Haotong Qin; Xianglong Liu

2024 ICML ICML 2024

Compressing Large Language Models by Joint Sparsification and Quantization

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Jinyang Guo, Jianyu Wu, Zining Wang, Jiaheng Liu, Ge Yang, Yifu Ding, Ruihao Gong, Haotong Qin, Xianglong Liu

Topics

Machine Learning > Application Areas > Efficient Computing Natural Language Processing > Resources & Methods > Large Language Models Artificial Intelligence > Core AI > Large Language Models

Keywords

quantization outliers computation reduction llama activation editor sparsification

Download PDF