Navigating Scaling Laws: Compute Optimality in Adaptive Model Training

Sotiris Anagnostidis; Gregor Bachmann; Imanol Schlag; Thomas Hofmann

2024 ICML ICML 2024

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Sotiris Anagnostidis, Gregor Bachmann, Imanol Schlag, Thomas Hofmann

Topics

Artificial Intelligence > Core AI > Foundation Models Machine Learning > Optimization & Theory > Optimization Deep Learning > Architectures > Neural Networks

Keywords

scaling law adaptive model compute optimal generalize model shape traverse

Download PDF