conftrace_

neural network initialization

33 papers

Explore in graph

Co-occurring keywords

neural network (6616) residual network (211) gradient descent (1144) network initialization (29) activation function (133) model compression (3302) free probability (4) convolutional neural network (4226) gaussian process (1200) neural network optimization (1293)

Papers

One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers NIPS 2019
Dynamical Isometry is Achieved in Residual Networks in a Universal Way for any Activation Function AISTATS 2019
Good Initializations of Variational Bayes for Deep Models ICML 2019
The emergence of spectral universality in deep networks AISTATS 2018
Towards Understanding Learning Representations: To What Extent Do Different Neural Networks Learn the Same Representation NIPS 2018
How to Start Training: The Effect of Initialization and Architecture NIPS 2018
The Shattered Gradients Problem: If resnets are the answer, then what is the question? ICML 2017
Improved Neural Network Initialization by Grouping Context-Dependent Targets for Acoustic Modeling INTERSPEECH 2016