Co-occurring keywords · papers mentioning both
Papers
The Warmup Dilemma: How Learning Rate Strategies Impact Speech-to-Text Model Convergence
ACL 2025
Towards Improved Risk Bounds for Transductive Learning
IJCAI 2025
Understanding Nonlinear Implicit Bias via Region Counts in Input Space
ICML 2025
Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs
ICLR 2025
Adaptive Conformal Inference by Betting
ICML 2024
Adaptive Learning Rate for Follow-the-Regularized-Leader: Competitive Analysis and Best-of-Both-Worlds
COLT 2024
ADOPT: Modified Adam Can Converge with Any β_2 with the Optimal Rate
NeurIPS 2024
A Learning Rate Path Switching Training Paradigm for Version Updates of Large Language Models
EMNLP 2024
A PDE-based Explanation of Extreme Numerical Sensitivities and Edge of Stability in Training Neural Networks
JMLR 2024
A Quadratic Synchronization Rule for Distributed Deep Learning
ICLR 2024
Benign Oscillation of Stochastic Gradient Descent with Large Learning Rate
ICLR 2024
Compute Better Spent: Replacing Dense Layers with Structured Matrices
ICML 2024
Efficient Recurrent Off-Policy RL Requires a Context-Encoder-Specific Learning Rate
NeurIPS 2024
Exact Mean Square Linear Stability Analysis for SGD
COLT 2024
Fast Equilibrium of SGD in Generic Situations
ICLR 2024
Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning
NeurIPS 2024
Iterate Averaging in the Quest for Best Test Error
JMLR 2024
LoRA+: Efficient Low Rank Adaptation of Large Models
ICML 2024
Non-stationary Online Convex Optimization with Arbitrary Delays
ICML 2024
On the Convergence of Hierarchical Federated Learning with Partial Worker Participation
UAI 2024
On the Hyperparameters in Stochastic Gradient Descent with Momentum
JMLR 2024
On the Target-kernel Alignment: a Unified Analysis with Kernel Complexity
NeurIPS 2024
On the Unstable Convergence Regime of Gradient Descent
AAAI 2024
Optimal Kernel Quantile Learning with Random Features
ICML 2024
Optimal Rates for Vector-Valued Spectral Regularization Learning Algorithms
NeurIPS 2024