conftrace_

gradient clipping

54 papers

Explore in graph

Co-occurring keywords

differential privacy (1016) stochastic gradient descent (1091) neural network optimization (1293) convergence analysis (395) stochastic optimization (1060) non-convex optimization (547) federated learning (1333) heavy-tailed noise (23) heavy-tailed distribution (98) gradient descent (1144)

Papers

Riemannian approach to batch normalization NIPS 2017
Relativistic Monte Carlo AISTATS 2017
Accurate Image Super-Resolution Using Very Deep Convolutional Networks CVPR 2016
On the difficulty of training recurrent neural networks ICML 2013