AMPA: Adaptive Mixed Precision Allocation for Low-Bit Integer Training

Li Ding; Wen Fei; Yuyang Huang; Shuangrui Ding; Wenrui Dai; Chenglin Li; Junni Zou; Hongkai Xiong

2024 ICML ICML 2024

AMPA: Adaptive Mixed Precision Allocation for Low-Bit Integer Training

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Li Ding, Wen Fei, Yuyang Huang, Shuangrui Ding, Wenrui Dai, Chenglin Li, Junni Zou, Hongkai Xiong

Topics

Machine Learning > Application Areas > Efficient Computing

Keywords

mixed-precision quantization bitops reduction layer-wise precision update low-bit integer training magnitude-based sensitivity measurement quantization influence

Download PDF