Skip to content
conftrace_
2024 ICML ICML 2024

QuIP$#$: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Albert Tseng, Jerry Chee, Qingyao Sun, Volodymyr Kuleshov, Christopher De Sa

Topics

Artificial Intelligence > Core AI > Model Compression Machine Learning > Application Areas > Efficient Computing Deep Learning > Models > Large Language Models

Keywords

quantization fine tuning hadamard transform llms e8 lattice lattice codebooks
Download PDF