learning rate

From Bayes’ Rule to Bayes Rules: Information Processing, Bayes’ Theorem, and Imprecise Probabilities UAI 2026 GR-Gauge: Cost-efficient Training Configuration By Gauging the Gradient Redundancy CVPR 2026 Optimizer Choice and Calibration for QARiB on Arabic-Script Social Media Offensive Language Detection EACL 2026 The Sample Complexity of Parameter-Free Stochastic Convex Optimization JMLR 2026 Adam-mini: Use Fewer Learning Rates To Gain More ICLR 2025 ALRMR-GEC: Adjusting Learning Rate Based on Memory Rate to Optimize the Edit Scorer for Grammatical Error Correction AAAI 2025 Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics ICML 2025 Data-dependent Bounds with T-Optimal Best-of-Both-Worlds Guarantees in Multi-Armed Bandits using Stability-Penalty Matching COLT 2025 Deconstructing What Makes a Good Optimizer for Autoregressive Language Models ICLR 2025 Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries ICLR 2025 Dynamical phases of short-term memory mechanisms in RNNs ICML 2025 Good regularity creates large learning rate implicit biases: edge of stability, balancing, and catapult JMLR 2025 Gradient descent with generalized Newton’s method ICLR 2025 HVAdam: A Full-Dimension Adaptive Optimizer AAAI 2025 Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum ACML 2025 Kernel-based L_2-Boosting with Structure Constraints JMLR 2025 Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility ICCV 2025 Learning Is Not A Race: Improving Retrieval in Language Models via Equal Learning EMNLP 2025 MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters ICML 2025 Revisiting Learning Rate Control AutoML 2025 Scaling Optimal LR Across Token Horizons ICLR 2025 Stabilizing Sharpness-Aware Minimization Through A Simple Renormalization Strategy JMLR 2025 Taking a Big Step: Large Learning Rates in Denoising Score Matching Prevent Memorization COLT 2025 Taming LLMs with Gradient Grouping ACL 2025 Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization IJCAI 2025