conftrace_

scaling law

120 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) model scaling (135) transfer learning (5449) neural network optimization (1293) zero-shot learning (3650) transformer architecture (1560) mixture of expert (640) compute budget (9) multimodal learning (4645)

Papers

Reward Learning as Doubly Nonparametric Bandits: Optimal Design and Scaling Laws AISTATS 2023
Scaling Laws for Generative Mixed-Modal Language Models ICML 2023
Roles of Scaling and Instruction Tuning in Language Perception: Model vs. Human Attention EMNLP 2023
Reproducible Scaling Laws for Contrastive Language-Image Learning CVPR 2023
Emergent Inabilities? Inverse Scaling Over the Course of Pretraining EMNLP 2023
TAN Without a Burn: Scaling Laws of DP-SGD ICML 2023
Likelihood-Based Diffusion Language Models NIPS 2023
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? EMNLP 2023
Exploring the Benefits and Limitations of Multilinguality for Non-autoregressive Machine Translation EMNLP 2022
RIGA at SemEval-2022 Task 1: Scaling Recurrent Neural Networks for CODWOE Dictionary Modeling NAACL 2022
Scaling Laws from the Data Manifold Dimension JMLR 2022
Scaling Up Vision-Language Pre-Training for Image Captioning CVPR 2022
More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize ICML 2022
Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments EMNLP 2022
An empirical analysis of compute-optimal large language model training NIPS 2022
Unified Scaling Laws for Routed Language Models ICML 2022
Model Performance Scaling with Multiple Data Sources ICML 2021
Data and Parameter Scaling Laws for Neural Machine Translation EMNLP 2021
On the Predictability of Pruning Across Scales ICML 2021
Scaling Laws for Acoustic Models INTERSPEECH 2021