conftrace_

free probability theory

4 papers

Explore in graph

Also known as

FPT

Co-occurring keywords

dynamical isometry (8) free probability (4) neural network initialization (33) spectral distribution (10) singular value (17) gradient propagation (34) sigmoid activation (6) edge of chao (5) jacobian analysis (4) network depth (29)

Papers

Free Probability for predicting the performance of feed-forward fully connected neural networks NIPS 2022
The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry AISTATS 2021
The emergence of spectral universality in deep networks AISTATS 2018
Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice NIPS 2017