SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight Compression

Mohammad Mozaffari; Amir Yazdanbakhsh; Maryam Mehri Dehnavi

2025 ICML ICML 2025

SLiM: One-shot Quantization and Sparsity with Low-rank Approximation for LLM Weight Compression

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Mohammad Mozaffari, Amir Yazdanbakhsh, Maryam Mehri Dehnavi

Topics

Artificial Intelligence > Core AI > Model Compression Machine Learning > Application Areas > Efficient Computing Deep Learning > Models > Large Language Models

Keywords

quantization low-rank approximation sparsity saliency function one-shot compression llama 2

Download PDF