Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Nikhil Sardana; Jacob Portes; Sasha Doubov; Jonathan Frankle

2024 ICML ICML 2024

Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Nikhil Sardana, Jacob Portes, Sasha Doubov, Jonathan Frankle

Topics

Machine Learning > Application Areas > Efficient Computing Natural Language Processing > Resources & Methods > Large Language Models Artificial Intelligence > Core AI > Large Language Models

Keywords

model quality compute budget parameter count training data size inference demand tokens per parameter

Download PDF