Skip to content
conftrace_
2024 COLT COLT 2024

Open Problem: Anytime Convergence Rate of Gradient Descent

Recent results show that vanilla gradient descent can be accelerated for smooth convex objectives, merely by changing the stepsize sequence. We show that this can lead to surprisingly large errors indefinitely, and therefore ask: Is there any stepsize schedule for gradient descent that accelerates the classic $\mathcal{O}(1/T)$ convergence rate, at \emph{any} stopping time $T$?

🌉 Interdisciplinary Bridge - Artificial Intelligence and Mathematics & Optimization

More from COLT 2024

All COLT 2024 papers →