conftrace_

learning rate scheduling

9 papers

Explore in graph

Co-occurring keywords

learning rate (192) training dynamics (118) large language model (13587) loss landscape (149) neural network optimization (1293) stochastic gradient descent (1091) training efficiency (60) weight prediction (8) convergence guarantee (169) generalization capability (50)

Papers

Super Level Sets and Exponential Decay: A Synergistic Approach to Stable Neural Network Training (Abstract Reprint) AAAI 2026
A Better Start: Sensitivity-Aware Warm-Up for Robust and Efficient Fine-Tuning AAAI 2026
Scaling and Transferability of Annealing Strategies in Large Language Model Training AAAI 2026
Scheduling Weight Transitions for Quantization-Aware Training ICCV 2025
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models EMNLP 2024
Hop, skip, jump to Convergence: Dynamics of Learning Rate Transitions for Improved Training of Large Language Models EMNLP 2024
Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning ACL 2023
Learning to Boost Training by Periodic Nowcasting Near Future Weights ICML 2023
Non-Asymptotic Analysis of Stochastic Approximation Algorithms for Machine Learning NIPS 2011