large batch training

Beyond the Mean: Fisher-Orthogonal Projection for Natural Gradient Descent in Large Batch Training AAAI 2026 MERIT: Maximum-normalized Element-wise Ratio for Language Model Large-batch Training ICML 2025 CowClip: Reducing CTR Prediction Model Training Time from 12 Hours to 10 Minutes on 1 GPU AAAI 2023 SLAMB: Accelerated Large Batch Training with Sparse Communication ICML 2023 Concurrent Adversarial Learning for Large-Batch Training ICLR 2022 Recall@k Surrogate Loss With Large Batches and Similarity Mixup CVPR 2022 Towards Efficient and Scalable Sharpness-Aware Minimization CVPR 2022 DecentLaM: Decentralized Momentum SGD for Large-Batch Deep Training ICCV 2021 Large Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling AAAI 2021 AdaScale SGD: A User-Friendly Algorithm for Distributed Training ICML 2020 An Empirical Study of Stochastic Gradient Descent with Structured Covariance Noise AISTATS 2020 Augment Your Batch: Improving Generalization Through Instance Repetition CVPR 2020 Extrapolation for Large-batch Training in Deep Learning ICML 2020 Inefficiency of K-FAC for Large Batch Size Training AAAI 2020 Stochastic Weight Averaging in Parallel: Large-Batch Training That Generalizes Well ICLR 2020 Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model NeurIPS 2019 Don't Decay the Learning Rate, Increase the Batch Size ICLR 2018 Hessian-based Analysis of Large Batch Training and Robustness to Adversaries NeurIPS 2018 Neumann Optimizer: A Practical Optimization Algorithm for Deep Neural Networks ICLR 2018 Scaling Neural Machine Translation EMNLP 2018 The Effect of Network Width on the Performance of Large-batch Training NeurIPS 2018 Train longer, generalize better: closing the generalization gap in large batch training of neural networks NeurIPS 2017