conftrace_

hyperparameter transfer

4 papers

Explore in graph

Co-occurring keywords

neural network optimization (1293) network dynamics (17) multi-armed bandit (1098) stochastic bandit (98) training dynamics (118) sparse training (77) sparse neural network (45) sparsity level (3) model scaling (135) sharpness aware minimization (8)

Papers

Offline-to-Online Hyperparameter Transfer for Stochastic Bandits AAAI 2025
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit ICLR 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024
$\boldsymbol{\mu}\mathbf{P^2}$: Effective Sharpness Aware Minimization Requires Layerwise Perturbation Scaling NIPS 2024