← Keywords

neural tangent kernel

205 papers

Explore in graph

Also known as

NTK

Co-occurring keywords

neural network (6616) gradient descent (1143) kernel methods (1096) representation learning (6174) feature learning (1309) gaussian process (1198) generalization bound (649) training dynamics (113) kernel regression (86) deep learning theory (36)

Papers

Frequency Bias in Neural Networks for Input of Non-Uniform Density ICML 2020
The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization ICML 2020
Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks NIPS 2020
A Generalized Neural Tangent Kernel Analysis for Two-layer Neural Networks NIPS 2020
Towards a General Theory of Infinite-Width Limits of Neural Classifiers ICML 2020
On the Similarity between the Laplace and Neural Tangent Kernels NIPS 2020
On Infinite-Width Hypernetworks NIPS 2020
Finite Versus Infinite Neural Networks: an Empirical Study NIPS 2020
Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks ICML 2020
Can Temporal-Diļ¬€erence and Q-Learning Learn Representation? A Mean-Field Theory NIPS 2020
Bayesian Deep Ensembles via the Neural Tangent Kernel NIPS 2020
Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel NIPS 2020
Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks NIPS 2020
The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks NIPS 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher NIPS 2020
Towards Understanding Hierarchical Learning: Benefits of Neural Representations NIPS 2020
Disentangling Trainability and Generalization in Deep Neural Networks ICML 2020
Collegial Ensembles NIPS 2020
Label-Aware Neural Tangent Kernel: Toward Better Generalization and Local Elasticity NIPS 2020
What Can ResNet Learn Efficiently, Going Beyond Kernels? NIPS 2019
On the Inductive Bias of Neural Tangent Kernels NIPS 2019
Generalization Bounds of Stochastic Gradient Descent for Wide and Deep Neural Networks NIPS 2019
Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels NIPS 2019
On Exact Computation with an Infinitely Wide Neural Net NIPS 2019
Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layers NIPS 2019