conftrace_

infinite width limit

14 papers

Explore in graph

Co-occurring keywords

neural network (6616) neural tangent kernel (205) gaussian process (1200) convolutional neural network (4226) neural network optimization (1293) kernel methods (1097) gradient descent dynamics (6) training dynamics (118) feature learning (1311) dropout ensemble (1)

Papers

Neural Tangent Kernels Under Stochastic Data Augmentation AAAI 2026
Infinite Limits of Multi-head Transformer Dynamics NIPS 2024
On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks JMLR 2024
Commutative Scaling of Width and Depth in Deep Neural Networks JMLR 2024
Feature-Learning Networks Are Consistent Across Widths At Realistic Scales NIPS 2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit NIPS 2023
Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022
Fast Neural Kernel Embeddings for General Activations NIPS 2022
A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs NIPS 2021
Tensor Programs IIb: Architectural Universality Of Neural Tangent Kernel Training Dynamics ICML 2021
Correlated weights in infinite limits of deep convolutional neural networks UAI 2021
The future is log-Gaussian: ResNets and their infinite-depth-and-width limit at initialization NIPS 2021
On Exact Computation with an Infinitely Wide Neural Net NIPS 2019
Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent NIPS 2019