Skip to content
conftrace_

scaling law

186 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (39) language model (31) model scaling (18) neural network optimization (14) transfer learning (12) mixture of expert (8) synthetic data (7) downstream performance (7) neural network (7) zero-shot learning (7)

Papers

More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize ICML 2022 Scale Efficiently: Insights from Pretraining and Finetuning Transformers ICLR 2022 Scaling Laws for Neural Machine Translation ICLR 2022 Scaling Laws from the Data Manifold Dimension JMLR 2022 Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments EMNLP 2022 Scaling Up Vision-Language Pre-Training for Image Captioning CVPR 2022 Unified Scaling Laws for Routed Language Models ICML 2022 Data and Parameter Scaling Laws for Neural Machine Translation EMNLP 2021 Model Performance Scaling with Multiple Data Sources ICML 2021 On the Predictability of Pruning Across Scales ICML 2021 Scaling Laws for Acoustic Models Interspeech 2021