What is the Long-Run Distribution of Stochastic Gradient Descent? A Large Deviations Analysis

Waı̈ss Azizian; Franck Iutzeler; Jérôme Malick; Panayotis Mertikopoulos

2024 ICML ICML 2024

What is the Long-Run Distribution of Stochastic Gradient Descent? A Large Deviations Analysis

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner

🌉 Interdisciplinary Bridge - Artificial Intelligence and Mathematics & Optimization

Authors

Waı̈ss Azizian, Franck Iutzeler, Jérôme Malick, Panayotis Mertikopoulos

Topics

Machine Learning > Optimization & Theory > Optimization Mathematics & Optimization > Mathematics > Probability Mathematics & Optimization > Optimization > Stochastic Methods

Keywords

stochastic gradient descent large deviation step-sizes boltzmann-gibbs distribution critical region energy levels

Download PDF