Skip to content
conftrace_

initialization variance

3 papers

Explore in graph

Co-occurring keywords · papers mentioning both

neural network optimization (2) finite-width correction (1) kernel variance (1) finite-width effect (1) dynamical mean field theory (1) deep relu net (1) gradient explosion (1) kernel methods (1) bias variance (1) exploding gradient (1)

Papers

Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks NeurIPS 2023 Understanding Double Descent Requires A Fine-Grained Bias-Variance Decomposition NeurIPS 2020 How to Start Training: The Effect of Initialization and Architecture NeurIPS 2018