conftrace_

training dynamics

118 papers

Explore in graph

Also known as

TD

Co-occurring keywords

neural network optimization (1293) neural network (6616) neural tangent kernel (205) language model (4599) gradient descent (1144) stochastic gradient descent (1091) large language model (13587) representation learning (6206) model scaling (135) convergence analysis (395)

Papers

SFTMix: Elevating Language Model Instruction Tuning with Mixup Recipe ACL 2026
Neural Tangent Kernels Under Stochastic Data Augmentation AAAI 2026
On the Hidden Objective Biases of Group-based Reinforcement Learning ACL 2026
Scaling and Transferability of Annealing Strategies in Large Language Model Training AAAI 2026
Learning from Evolving Training Dynamics: An Entropy-Maximizing Data Curation Strategy for LLM Supervised Post-Training ACL 2026
Deconstructing Pre-training: Knowledge Attribution Analysis in MoE and Dense Models AAAI 2026
Exploring smaller batch sizes for a high-performing BabyLM model architecture EMNLP 2025
Data Drives Unstable Hierarchical Generalization in LMs EMNLP 2025
Token-Level Metrics for Detecting Incorrect Gold Annotations in Named Entity Recognition EMNLP 2025
Your Model is Overconfident, and Other Lies We Tell Ourselves ACL 2025
Identifying Noise in Human-Created Datasets using Training Dynamics from Generative Models EMNLP 2025
DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognition NAACL 2025
A Proactive Reliability Metric for Detecting Failures in Language Model Training EMNLP 2025
FTFT: Efficient and Robust Fine-Tuning by Transferring Training Dynamics COLING 2025
Random Pruning Over-parameterized Neural Networks Can Improve Generalization: A Training Dynamics Analysis JMLR 2025
Linear Steerability in Language Models: When It Emerges and How It Evolves EMNLP 2025
Hallucination Detox: Sensitivity Dropout (SenD) for Large Language Model Training ACL 2025
Common Ground, Diverse Roots: The Difficulty of Classifying Common Examples in Spanish Varieties COLING 2025
Understanding Silent Data Corruption in LLM Training ACL 2025
When Can We Approximate Wide Contrastive Models with Neural Tangent Kernels and Principal Component Analysis? AAAI 2025
Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning ACL 2025
SOI Matters: Analyzing Multi-Setting Training Dynamics in Pretrained Language Models via Subsets of Interest EMNLP 2025
Analyzing Offensive Language Dataset Insights from Training Dynamics and Human Agreement Level COLING 2025
The Surprising Effectiveness of Infinite-Width NTKs for Characterizing and Improving Model Training AAAI 2025
Convergence and Divergence of Language Models under Different Random Seeds EMNLP 2025