conftrace_

gradient variance

31 papers

Explore in graph

Co-occurring keywords

stochastic gradient descent (1091) variational inference (2069) neural network optimization (1293) stochastic gradient (296) batch size (34) large language model (13587) control variate (54) large-batch training (5) adversarial example (564) language model (4599)

Papers

Augment Your Batch: Improving Generalization Through Instance Repetition CVPR 2020
Provable Gradient Variance Guarantees for Black-Box Variational Inference NIPS 2019
Dissecting Adam: The Sign, Magnitude and Variance of Stochastic Gradients ICML 2018
Using Large Ensembles of Control Variates for Variational Inference NIPS 2018
Pathwise Derivatives Beyond the Reparameterization Trick ICML 2018
Not All Samples Are Created Equal: Deep Learning with Importance Sampling ICML 2018