conftrace_

training dynamics

118 papers

Explore in graph

Also known as

TD

Co-occurring keywords

neural network optimization (1293) neural network (6616) neural tangent kernel (205) language model (4599) gradient descent (1144) stochastic gradient descent (1091) large language model (13587) representation learning (6206) model scaling (135) convergence analysis (395)

Papers

Training stochastic stabilized supralinear networks by dynamics-neutral growth NIPS 2022
Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU EMNLP 2022
Staged Training for Transformer Language Models ICML 2022
A Data Cartography based MixUp for Pre-trained Language Models NAACL 2022
The Birth of Bias: A case study on the evolution of gender bias in an English language model NAACL 2022
Rethinking Influence Functions of Neural Networks in the Over-Parameterized Regime AAAI 2022
Instability and Local Minima in GAN Training with Kernel Discriminators NIPS 2022
Training Dynamics for Text Summarization Models ACL 2022
Emergent Structures and Training Dynamics in Large Language Models ACL 2022
Surprising Instabilities in Training Deep Networks and a Theoretical Analysis NIPS 2022
Deep Active Learning by Leveraging Training Dynamics NIPS 2022
Neural Tangent Kernel Analysis of Deep Narrow Neural Networks ICML 2022
Data Cartography for Low-Resource Neural Machine Translation EMNLP 2022
Leveraging Training Dynamics and Self-Training for Text Classification EMNLP 2022
Data-Efficient Augmentation for Training Neural Networks NIPS 2022
On Large-Cohort Training for Federated Learning NIPS 2021
Conflicting Bundles: Adapting Architectures Towards the Improved Training of Deep Neural Networks WACV 2021
Cartography Active Learning EMNLP 2021
The Dynamics of Gradient Descent for Overparametrized Neural Networks L4DC 2021
On the Neural Tangent Kernel of Deep Networks with Orthogonal Initialization IJCAI 2021
How Do Adam and Training Strategies Help BNNs Optimization ICML 2021
Training Dynamic based data filtering may not work for NLP datasets EMNLP 2021
Tensor Programs IIb: Architectural Universality Of Neural Tangent Kernel Training Dynamics ICML 2021
Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training NIPS 2021
What training reveals about neural network complexity NIPS 2021