← Keywords

neural tangent kernel

205 papers

Explore in graph

Also known as

NTK

Co-occurring keywords

neural network (6616) gradient descent (1143) kernel methods (1096) representation learning (6174) feature learning (1309) gaussian process (1198) generalization bound (649) training dynamics (113) kernel regression (86) deep learning theory (36)

Papers

Exact, Tractable Gauss-Newton Optimization in Deep Reversible Architectures Reveal Poor Generalization NIPS 2024
Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networks JMLR 2024
MOTE-NAS: Multi-Objective Training-based Estimate for Efficient Neural Architecture Search NIPS 2024
How does Gradient Descent Learn Features --- A Local Analysis for Regularized Two-Layer Neural Networks NIPS 2024
Finding Lottery Tickets in Vision Models via Data-driven Spectral Foresight Pruning CVPR 2024
On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory NIPS 2024
A generalized neural tangent kernel for surrogate gradient learning NIPS 2024
Batch Normalization Alleviates the Spectral Bias in Coordinate Networks CVPR 2024
Provable Acceleration of Nesterov’s Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks IJCAI 2024
Continual learning with the neural tangent ensemble NIPS 2024
Error Correction Output Codes for Robust Neural Networks against Weight-errors: A Neural Tangent Kernel Point of View NIPS 2024
Overparametrized Multi-layer Neural Networks: Uniform Concentration of Neural Tangent Kernel and Convergence of Stochastic Gradient Descent JMLR 2024
Temporal Graph Neural Tangent Kernel with Graphon-Guaranteed NIPS 2024
Matryoshka Policy Gradient for Entropy-Regularized RL: Convergence and Global Optimality JMLR 2024
Once Read is Enough: Domain-specific Pretraining-free Language Models with Cluster-guided Sparse Experts for Long-tail Domain Knowledge NIPS 2024
Stability and Generalization of Adversarial Training for Shallow Neural Networks with Smooth Activation NIPS 2024
Super Consistency of Neural Network Landscapes and Learning Rate Transfer NIPS 2024
NTK-approximating MLP Fusion for Efficient Language Model Fine-tuning ICML 2023
A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel ICML 2023
Benign Overfitting in Deep Neural Networks under Lazy Training ICML 2023
Gradient Descent in Neural Networks as Sequential Learning in Reproducing Kernel Banach Space ICML 2023
Stochastic Marginal Likelihood Gradients using Neural Tangent Kernels ICML 2023
Combinatorial Neural Bandits ICML 2023
Dataset Distillation with Convexified Implicit Gradients ICML 2023
Provably and Practically Efficient Neural Contextual Bandits ICML 2023