conftrace_
← Optimization & Theory
Machine Learning › Optimization & Theory ›

Neural Network Optimization

3,649 papers

Papers per year

2
5
40
414
386
'05
'10
'15
'20
'25

Papers

Fisher SAM: Information Geometry and Sharpness Aware Minimisation ICML 2022
Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation ICML 2022
Convergence of Policy Gradient for Entropy Regularized MDPs with Neural Network Approximation in the Mean-Field Regime ICML 2022
Neural Tangent Kernel Analysis of Deep Narrow Neural Networks ICML 2022
Robust Training of Neural Networks Using Scale Invariant Architectures ICML 2022
On Convergence of Gradient Descent Ascent: A Tight Local Analysis ICML 2022
High Probability Guarantees for Nonconvex Stochastic Gradient Descent with Heavy Tails ICML 2022
Robust Training under Label Noise by Over-parameterization ICML 2022
Fast Convex Optimization for Two-Layer ReLU Networks: Equivalent Model Classes and Cone Decompositions ICML 2022
Power-Law Escape Rate of SGD ICML 2022
Bounding the Width of Neural Networks via Coupled Initialization A Worst Case Analysis ICML 2022
Implicit Bias of the Step Size in Linear Diagonal Neural Networks ICML 2022
Improving Transformers with Probabilistic Attention Keys ICML 2022
Fast Finite Width Neural Tangent Kernel ICML 2022
Anticorrelated Noise Injection for Improved Generalization ICML 2022
Neural Network Pruning Denoises the Features and Makes Local Connectivity Emerge in Visual Tasks ICML 2022
Differentiable Top-k Classification Learning ICML 2022
A Differential Entropy Estimator for Training Neural Networks ICML 2022
A Simple Guard for Learned Optimizers ICML 2022
Generalized Federated Learning via Sharpness Aware Minimization ICML 2022
LyaNet: A Lyapunov Framework for Training Neural ODEs ICML 2022
Convergence Rates of Non-Convex Stochastic Gradient Descent Under a Generic Lojasiewicz Condition and Local Smoothness ICML 2022
Continuous-Time Analysis of Accelerated Gradient Methods via Conservation Laws in Dilated Coordinate Systems ICML 2022
On the Finite-Time Complexity and Practical Computation of Approximate Stationarity Concepts of Lipschitz Functions ICML 2022
Extended Unconstrained Features Model for Exploring Deep Neural Collapse ICML 2022