infinite-width limit

A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks JMLR 2026 Neural Tangent Kernels Under Stochastic Data Augmentation AAAI 2026 Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation ICLR 2025 On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory JMLR 2025 When narrower is better: the narrow width limit of Bayesian parallel branching neural networks ICLR 2025 $\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling NeurIPS 2024 An Infinite-Width Analysis on the Jacobian-Regularised Training of a Neural Network ICML 2024 A Rainbow in Deep Network Black Boxes JMLR 2024 Beyond IID weights: sparse and low-rank deep Neural Networks are also Gaussian Processes ICLR 2024 Commutative Scaling of Width and Depth in Deep Neural Networks JMLR 2024 Emergent Equivariance in Deep Ensembles ICML 2024 Infinite Limits of Multi-head Transformer Dynamics NeurIPS 2024 On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks JMLR 2024 Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit JMLR 2024 Adaptive Optimization in the ∞-Width Limit ICLR 2023 A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel ICML 2023 Deep Neural Networks with Dependent Weights: Gaussian Process Mixture Limit, Heavy Tails, Sparsity and Compressibility JMLR 2023 Feature-Learning Networks Are Consistent Across Widths At Realistic Scales NeurIPS 2023 Global optimality of Elman-type RNNs in the mean-field regime ICML 2023 Neural signature kernels as infinite-width-depth-limits of controlled ResNets ICML 2023 The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit NeurIPS 2023 Width and Depth Limits Commute in Residual Networks ICML 2023 Embedded Ensembles: infinite width limit and operating regimes AISTATS 2022 Fast Neural Kernel Embeddings for General Activations NeurIPS 2022 Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization ICML 2022