← Keywords

neural tangent kernel

205 papers

Explore in graph

Also known as

NTK

Co-occurring keywords

neural network (6616) gradient descent (1143) kernel methods (1096) representation learning (6174) feature learning (1309) gaussian process (1198) generalization bound (649) training dynamics (113) kernel regression (86) deep learning theory (36)

Papers

On the Provable Generalization of Recurrent Neural Networks NIPS 2021
One-pass Stochastic Gradient Descent in overparametrized two-layer neural networks AISTATS 2021
A Dynamical View on Optimization Algorithms of Overparameterized Neural Networks AISTATS 2021
Avoiding Kernel Fixed Points: Computing with ELU and GELU Infinite Networks AAAI 2021
On random kernels of residual architectures UAI 2021
On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models ICML 2021
A Theoretical Analysis of Catastrophic Forgetting through the NTK Overlap Matrix AISTATS 2021
Implicit Regularization via Neural Feature Alignment AISTATS 2021
Deep Networks Provably Classify Data on Curves NIPS 2021
Local Signal Adaptivity: Provable Feature Learning in Neural Networks Beyond Kernels NIPS 2021
Efficient Statistical Tests: A Neural Tangent Kernel Approach ICML 2021
Fast Sketching of Polynomial Kernels of Polynomial Degree ICML 2021
Tilting the playing field: Dynamical loss functions for machine learning ICML 2021
Scaling Neural Tangent Kernels via Sketching and Random Features NIPS 2021
On the Neural Tangent Kernel of Deep Networks with Orthogonal Initialization IJCAI 2021
Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? --- A Neural Tangent Kernel Perspective NIPS 2020
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains NIPS 2020
On the linearity of large non-linear models: when and why the tangent kernel is constant NIPS 2020
Infinite attention: NNGP and NTK for deep attention networks ICML 2020
Learning Over-Parametrized Two-Layer Neural Networks beyond NTK COLT 2020
Neural Kernels Without Tangents ICML 2020
Finding trainable sparse networks through Neural Tangent Transfer ICML 2020
Associative Memory in Iterated Overparameterized Sigmoid Autoencoders ICML 2020
Generalized Leverage Score Sampling for Neural Networks NIPS 2020
Dynamics of Deep Neural Networks and Neural Tangent Hierarchy ICML 2020