conftrace_

mini-batch size

7 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) variance reduction (523) distributed learning (563) stochastic optimization (1060) asynchronous stochastic gradient descent (13) cross-iteration computation (1) taylor polynomial (1) mini-batch learning (9) over-parametrized learning (1) arbitrary sampling (2)

Papers

Faster Double Adaptive Gradient Methods AAAI 2025
Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes AISTATS 2021
Cross-Iteration Batch Normalization CVPR 2021
SGD: General Analysis and Improved Rates ICML 2019
Towards closing the gap between the theory and practice of SVRG NIPS 2019
Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation EMNLP 2018
The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning ICML 2018