conftrace_

scaling law

120 papers

Explore in graph

Co-occurring keywords

large language model (13587) language model (4599) model scaling (135) transfer learning (5449) neural network optimization (1293) zero-shot learning (3650) transformer architecture (1560) mixture of expert (640) compute budget (9) multimodal learning (4645)

Papers

Algorithmic progress in language models NIPS 2024
Training Compute-Optimal Protein Language Models NIPS 2024
A Proposal for Scaling the Scaling Laws EACL 2024
Emergent Abilities in Reduced-Scale Generative Language Models NAACL 2024
On the Scalability of Diffusion-based Text-to-Image Generation CVPR 2024
Collaborative Performance Prediction for Large Language Models EMNLP 2024
Scaling Laws Across Model Architectures: A Comparative Analysis of Dense and MoE Models in Large Language Models EMNLP 2024
Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scale EMNLP 2024
Scaling Laws for Data Filtering-- Data Curation cannot be Compute Agnostic CVPR 2024
Scaling Behavior for Large Language Models regarding Numeral Systems: An Example using Pythia EMNLP 2024
On the Scaling Laws of Geographical Representation in Language Models COLING 2024
A Model for Estimating the Economic Costs of Computer Vision Systems That Use Deep Learning AAAI 2024
Are More LLM Calls All You Need? Towards the Scaling Properties of Compound AI Systems NIPS 2024
Measuring Cross-lingual Transfer in Bytes NAACL 2024
ScalingFilter: Assessing Data Quality through Inverse Utilization of Scaling Laws EMNLP 2024
CMR Scaling Law: Predicting Critical Mixture Ratios for Continual Pre-training of Language Models EMNLP 2024
Scaling Laws for Linear Complexity Language Models EMNLP 2024
Scaling Parameter-Constrained Language Models with Quality Data EMNLP 2024
Scaling Laws for Fact Memorization of Large Language Models EMNLP 2024
Scaling Laws of Synthetic Images for Model Training ... for Now CVPR 2024
Observational Scaling Laws and the Predictability of Langauge Model Performance NIPS 2024
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem NIPS 2024
Exploring Molecular Pretraining Model at Scale NIPS 2024
Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices NIPS 2024
No "Zero-Shot" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance NIPS 2024