gradient clipping

Can gradient clipping mitigate label noise? ICLR 2020 Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020 Improved Analysis of Clipping Algorithms for Non-convex Optimization NeurIPS 2020 Stochastic Optimization with Heavy-Tailed Noise via Accelerated Gradient Clipping NeurIPS 2020 Understanding Generalization in Recurrent Neural Networks ICLR 2020 Understanding Gradient Clipping in Private SGD: A Geometric Perspective NeurIPS 2020 Why are Adaptive Methods Good for Attention Models? NeurIPS 2020 Why Gradient Clipping Accelerates Training: A Theoretical Justification for Adaptivity ICLR 2020 Differential Privacy Has Disparate Impact on Model Accuracy NeurIPS 2019 Exploring Fast and Communication-Efficient Algorithms in Large-Scale Distributed Networks AISTATS 2019 Relativistic Monte Carlo AISTATS 2017 Riemannian approach to batch normalization NeurIPS 2017 Accurate Image Super-Resolution Using Very Deep Convolutional Networks CVPR 2016 On the difficulty of training recurrent neural networks ICML 2013