mean field theory

On Layer Normalization in the Transformer Architecture ICML 2020 Predictive coding in balanced neural networks with noise, chaos and delays NeurIPS 2020 Quantitative Propagation of Chaos for SGD in Wide Neural Networks NeurIPS 2020 Towards a General Theory of Infinite-Width Limits of Neural Classifiers ICML 2020 A Mean Field Theory of Batch Normalization ICLR 2019 A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off NeurIPS 2019 Mean-field theory of two-layers neural networks: dimension-free bounds and kernel limit COLT 2019 Modelling the Dynamics of Multiagent Q-Learning in Repeated Symmetric Games: a Mean Field Theoretic Approach NeurIPS 2019 Neuron birth-death dynamics accelerates gradient descent and converges asymptotically ICML 2019 Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019 Critical initialisation for deep signal propagation in noisy rectifier neural networks NeurIPS 2018 Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks ICML 2018 Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks ICML 2018 Mean-field theory of graph neural networks in graph partitioning NeurIPS 2018 Mean Field Residual Networks: On the Edge of Chaos NeurIPS 2017 Exponential expressivity in deep neural networks through transient chaos NeurIPS 2016 Capacity of strong attractor patterns to model behavioural and cognitive prototypes NeurIPS 2013 Natural Image Denoising with Convolutional Networks NeurIPS 2008 On Computational Power and the Order-Chaos Phase Transition in Reservoir Computing NeurIPS 2008