conftrace_

free probability theory

4 papers

Explore in graph

Also known as

FPT

Co-occurring keywords · papers mentioning both

dynamical isometry (2) free probability (2) neural network initialization (2) singular value (1) gradient propagation (1) sigmoid activation (1) edge of chao (1) jacobian analysis (1) spectral distribution (1) network depth (1)

Papers

Free Probability for predicting the performance of feed-forward fully connected neural networks NeurIPS 2022 The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry AISTATS 2021 The emergence of spectral universality in deep networks AISTATS 2018 Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice NeurIPS 2017