Skip to content
conftrace_

large batch optimization

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

feature pyramid network (1) bert pretraining (1) adaptive gradient variance modulator (1) batch size scaling (1) dense visual prediction (1) layerwise adaptive learning rate (1) gradient variance (1) gradient compression (1) communication efficiency (1) instance segmentation (1)

Papers

Communication-efficient Distributed Learning for Large Batch Optimization ICML 2022 Large-batch Optimization for Dense Visual Predictions: Training Faster R-CNN in 4.2 Minutes NeurIPS 2022 Large Batch Optimization for Deep Learning: Training BERT in 76 minutes ICLR 2020