Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization

Haocheng Xi; Yuxiang Chen; Kang Zhao; Kai Jun Teh; Jianfei Chen; Jun Zhu

2024 ICML ICML 2024

Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Haocheng Xi, Yuxiang Chen, Kang Zhao, Kai Jun Teh, Jianfei Chen, Jun Zhu

Topics

Machine Learning > Application Areas > Efficient Computing Deep Learning > Architectures > Transformers Artificial Intelligence > Core AI > Large Language Models

Keywords

quantization transformer block data flow speedups int8 per-block quantization

Download PDF