kernel regime

How Feature Learning Can Improve Neural Scaling Laws ICLR 2025 Implicit Bias of Mirror Flow for Shallow Neural Networks in Univariate Regression ICLR 2025 Three Mechanisms of Feature Learning in a Linear Network ICLR 2025 On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks JMLR 2024 Why Do You Grok? A Theoretical Analysis on Grokking Modular Addition ICML 2024 Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime NeurIPS 2022 What Happens after SGD Reaches Zero Loss? --A Mathematical Framework ICLR 2022 Implicit Bias of Linear RNNs ICML 2021 Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy NeurIPS 2020 Kernel and Rich Regimes in Overparametrized Models COLT 2020 The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks NeurIPS 2020 Gradient Dynamics of Shallow Univariate ReLU Networks NeurIPS 2019