conftrace_

training dynamics

118 papers

Explore in graph

Also known as

TD

Co-occurring keywords

neural network optimization (1293) neural network (6616) neural tangent kernel (205) language model (4599) gradient descent (1144) stochastic gradient descent (1091) large language model (13587) representation learning (6206) model scaling (135) convergence analysis (395)

Papers

Learning, Forgetting, Remembering: Insights From Tracking LLM Memorization During Training EMNLP 2024
Tending Towards Stability: Convergence Challenges in Small Language Models EMNLP 2024
Soft ascent-descent as a stable and flexible alternative to flooding NIPS 2024
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem NIPS 2024
Learning Discriminative Dynamics with Label Corruption for Noisy Label Detection CVPR 2024
Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks NIPS 2024
Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes NIPS 2024
CLUES: Collaborative Private-domain High-quality Data Selection for LLMs via Training Dynamics NIPS 2024
Unveil Benign Overfitting for Transformer in Vision: Training Dynamics, Convergence, and Generalization NIPS 2024
Training Trajectories of Language Models Across Scales ACL 2023
Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width NIPS 2023
Memorisation Cartography: Mapping out the Memorisation-Generalisation Continuum in Neural Machine Translation EMNLP 2023
QADYNAMICS: Training Dynamics-Driven Synthetic QA Diagnostic for Zero-Shot Commonsense Question Answering EMNLP 2023
Spectral Evolution and Invariance in Linear-width Neural Networks NIPS 2023
Does Continual Learning Equally Forget All Parameters? ICML 2023
TRIAGE: Characterizing and auditing training data for improved regression NIPS 2023
Is This Loss Informative? Faster Text-to-Image Customization by Tracking Objective Dynamics NIPS 2023
On the Training Instability of Shuffling SGD with Batch Normalization ICML 2023
Bifurcations and loss jumps in RNN training NIPS 2023
Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer NIPS 2023
TiDAL: Learning Training Dynamics for Active Learning ICCV 2023
Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling ICML 2023
Learning from Training Dynamics: Identifying Mislabeled Data beyond Manually Designed Features AAAI 2023
Towards Understanding the Condensation of Neural Networks at Initial Training NIPS 2022
Real-Valued Backpropagation is Unsuitable for Complex-Valued Neural Networks NIPS 2022