conftrace_

preconditioned optimization

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

neural network optimization (2) stochastic gradient descent (2) hessian rank (1) preconditioning matrix (1) noisy quadratic model (1) large batch training (1) ornstein-uhlenbeck process (1) hessian matrix (1) stochastic process (1) convergence analysis (1)

Papers

The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank AAAI 2024 Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model NeurIPS 2019