scaling law

Data Selection via Optimal Control for Language Models ICLR 2025 Demystifying Synthetic Data in LLM Pre-training: A Systematic Study of Scaling Laws, Benefits, and Pitfalls EMNLP 2025 Determinant Estimation under Memory Constraints and Neural Scaling Laws ICML 2025 Differential learning kinetics govern the transition from memorization to generalization during in-context learning ICLR 2025 Distillation Scaling Laws ICML 2025 High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws ICLR 2025 How Does Critical Batch Size Scale in Pre-training? ICLR 2025 How to inject knowledge efficiently? Knowledge Infusion Scaling Law for Pre-training Large Language Models EMNLP 2025 Improving the Scaling Laws of Synthetic Data with Deliberate Practice ICML 2025 Inference Optimal VLMs Need Fewer Visual Tokens and More Parameters ICLR 2025 Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for LLM Problem-Solving ICLR 2025 Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient ICML 2025 Language models scale reliably with over-training and on downstream tasks ICLR 2025 Low-Bit Quantization Favors Undertrained LLMs ACL 2025 Memory Layers at Scale ICML 2025 (Mis)Fitting Scaling Laws: A Survey of Scaling Law Fitting Techniques in Deep Learning ICLR 2025 Model Steering: Learning with a Reference Model Improves Generalization Bounds and Scaling Laws ICML 2025 Neurons to Words: A Novel Method for Automated Neural Network Interpretability and Alignment AAAI 2025 Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions EMNLP 2025 Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling ICML 2025 OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models ICML 2025 P2 Law: Scaling Law for Post-Training After Model Pruning ACL 2025 Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models ICML 2025 Parametric Scaling Law of Tuning Bias in Conformal Prediction ICML 2025 Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws ICLR 2025