conftrace_

training dynamics

118 papers

Explore in graph

Also known as

TD

Co-occurring keywords

neural network optimization (1293) neural network (6616) neural tangent kernel (205) language model (4599) gradient descent (1144) stochastic gradient descent (1091) large language model (13587) representation learning (6206) model scaling (135) convergence analysis (395)

Papers

Deep Learning on a Data Diet: Finding Important Examples Early in Training NIPS 2021
Observing the Learning Curve of NMT Systems With Regard to Linguistic Phenomena IJCNLP 2021
Phase Diagram for Two-layer ReLU Neural Networks at Infinite-width Limit JMLR 2021
Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel NIPS 2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density ICML 2020
Cooperative Initialization based Deep Neural Network Training WACV 2020
On the Robustness and Training Dynamics of Raw Waveform Models INTERSPEECH 2020
VECA: A Method for Detecting Overfitting in Neural Networks (Student Abstract) AAAI 2020
Towards a General Theory of Infinite-Width Limits of Neural Classifiers ICML 2020
Finding trainable sparse networks through Neural Tangent Transfer ICML 2020
On the training dynamics of deep networks with $L_2$ regularization NIPS 2020
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics EMNLP 2020
Predicting Training Time Without Training NIPS 2020
A Solvable High-Dimensional Model of GAN NIPS 2019
Towards a Better Understanding and Regularization of GAN Training Dynamics UAI 2019
Gradient Descent Finds Global Minima of Deep Neural Networks ICML 2019
LCA: Loss Change Allocation for Neural Network Training NIPS 2019
Comparing Dynamics: Deep Neural Networks versus Glassy Systems ICML 2018