conftrace_

ornstein-uhlenbeck process

5 papers

Explore in graph

Also known as

OU

Co-occurring keywords

stochastic process (388) stochastic gradient descent (1091) non-stationary learning (19) parameter reset (1) adaptive drift (1) fractional brownian motion (2) saddle point (95) saddle point escape (8) neural network (6616) preconditioned optimization (1)

Papers

Non-Stationary Learning of Neural Networks with Automatic Soft Parameter Reset NIPS 2024
The Expected Loss of Preconditioned Langevin Dynamics Reveals the Hessian Rank AAAI 2024
On the Theoretical Properties of Noise Correlation in Stochastic Optimization NIPS 2022
Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process COLT 2020
PCA of high dimensional random walks with comparison to neural network training NIPS 2018