conftrace_

gradient vanishing

29 papers

Explore in graph

Co-occurring keywords

recurrent neural network (1790) spiking neural network (331) neural network optimization (1293) surrogate gradient (31) vanishing gradient (43) convolutional neural network (4226) residual network (211) layer normalization (65) long-term dependency (44) gradient propagation (34)

Papers

How to Start Training: The Effect of Initialization and Architecture NIPS 2018
All You Need Is Beyond a Good Init: Exploring Better Solution for Training Extremely Deep Convolutional Neural Networks With Orthonormality and Modulation CVPR 2017
Self-Normalizing Neural Networks NIPS 2017
Unitary Evolution Recurrent Neural Networks ICML 2016