Skip to content
conftrace_

critical batch size

3 papers

Explore in graph

Also known as

CBS

Co-occurring keywords · papers mentioning both

neural network optimization (2) two time-scale update rule (1) fréchet inception distance (1) adamw optimizer (1) stochastic first-order oracle (1) batch size (1) data parallelism (1) learning rate warmup (1) gpt training (1) generative adversarial network (1)

Papers

How Does Critical Batch Size Scale in Pre-training? ICLR 2025 Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training NeurIPS 2024 Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule ICML 2023