← Keywords

mean field theory

20 papers

Explore in graph

Also known as

MFT

Co-occurring keywords

neural network (6616) neural network optimization (1293) initialization scheme (8) signal propagation (20) gradient descent (1143) recurrent neural network (1790) deep neural network (1801) dynamical isometry (8) vanishing gradient (43) mean-field theory (19)

Papers

Statistical field theory for Markov decision processes under uncertainty JMLR 2025
Symmetries in Overparametrized Neural Networks: A Mean Field View NIPS 2024
Adversarial Training from Mean Field Perspective NIPS 2023
Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks NIPS 2023
A time-resolved theory of information encoding in recurrent neural networks NIPS 2022
Particle Dual Averaging: Optimization of Mean Field Neural Network with Global Convergence Rate Analysis NIPS 2021
Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training NIPS 2021
Can Temporal-Diļ¬€erence and Q-Learning Learn Representation? A Mean-Field Theory NIPS 2020
On Layer Normalization in the Transformer Architecture ICML 2020
A Mean Field Theory of Quantized Deep Networks: The Quantization-Depth Trade-Off NIPS 2019
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019
Neuron birth-death dynamics accelerates gradient descent and converges asymptotically ICML 2019
Modelling the Dynamics of Multiagent Q-Learning in Repeated Symmetric Games: a Mean Field Theoretic Approach NIPS 2019
Critical initialisation for deep signal propagation in noisy rectifier neural networks NIPS 2018
Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks ICML 2018
Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks ICML 2018
Mean Field Residual Networks: On the Edge of Chaos NIPS 2017
Exponential expressivity in deep neural networks through transient chaos NIPS 2016
Capacity of strong attractor patterns to model behavioural and cognitive prototypes NIPS 2013
Natural Image Denoising with Convolutional Networks NIPS 2008