conftrace_
2016 ICML ICML 2016

Solving Ridge Regression using Sketched Preconditioned SVRG

Abstract

We develop a novel preconditioning method for ridge regression, based on recent linear sketching methods. By equipping Stochastic Variance Reduced Gradient (SVRG) with this preconditioning process, we obtain a significant speed-up relative to fast stochastic methods such as SVRG, SDCA and SAG.

🌉 Interdisciplinary Bridge - Machine Learning and Mathematics & Optimization
🧭 Keyword Pioneer - numerical optimization
🐝 Cross-Pollinator - Artificial Intelligence, Machine Learning, Mathematics & Optimization, Natural Language Processing
📈 Trend Setter - Numerical Analysis