conftrace_

second-order method

38 papers

Explore in graph

Co-occurring keywords

second-order optimization (93) stochastic optimization (1060) newton method (64) hessian approximation (41) convex optimization (1321) neural network optimization (1293) stochastic gradient descent (1091) first-order method (89) regret bound (1926) linear convergence (158)

Papers

Adaptive Online Kernel Sampling for Vertex Classification AISTATS 2020
The Common-directions Method for Regularized Empirical Risk Minimization JMLR 2019
EA-CG: An Approximate Second-Order Method for Training Fully-Connected Neural Networks AAAI 2019
Limitations of the empirical Fisher approximation for natural gradient descent NIPS 2019
Small Steps and Giant Leaps: Minimal Newton Solvers for Deep Learning ICCV 2019
Stochastic Second-Order Method for Large-Scale Nonconvex Sparse Learning Models IJCAI 2018
Large Scale Empirical Risk Minimization via Truncated Adaptive Newton Method AISTATS 2018
A Distributed Second-Order Algorithm You Can Trust ICML 2018
Oracle Complexity of Second-Order Methods for Finite-Sum Problems ICML 2017
Efficient Second-Order Online Kernel Learning with Adaptive Embedding NIPS 2017
Newton Greedy Pursuit: A Quadratic Approximation Method for Sparsity-Constrained Optimization CVPR 2014
Exploiting Feature Covariance in High-Dimensional Online Learning AISTATS 2010
Periodic Step Size Adaptation for Single Pass On-line Learning NIPS 2009