conftrace_

hessian approximation

41 papers

Explore in graph

Co-occurring keywords

quasi-newton method (60) second-order optimization (93) stochastic gradient descent (1091) second-order method (38) stochastic optimization (1060) newton method (64) neural network optimization (1293) convergence rate (607) superlinear convergence (24) markov chain monte carlo (725)

Papers

A Class of Parallel Doubly Stochastic Algorithms for Large-Scale Learning JMLR 2020
Do Subsampled Newton Methods Work for High-Dimensional Data? AAAI 2020
WoodFisher: Efficient Second-Order Approximation for Neural Network Compression NIPS 2020
Quasi-Newton Trust Region Policy Optimization CORL 2019
EA-CG: An Approximate Second-Order Method for Training Fully-Connected Neural Networks AAAI 2019
Small Steps and Giant Leaps: Minimal Newton Solvers for Deep Learning ICCV 2019
Efficient Learning of Restricted Boltzmann Machines Using Covariance Estimates ACML 2019
Large Scale Empirical Risk Minimization via Truncated Adaptive Newton Method AISTATS 2018
Inexact trust-region algorithms on Riemannian manifolds NIPS 2018
Sub-sampled Cubic Regularization for Non-convex Optimization ICML 2017
Asynchronous Stochastic Gradient Descent with Delay Compensation ICML 2017
Fast large-scale optimization by unifying stochastic gradient and quasi-Newton methods ICML 2014
Newton Greedy Pursuit: A Quadratic Approximation Method for Sparsity-Constrained Optimization CVPR 2014
Fast Probabilistic Optimization from Noisy Gradients ICML 2013
Quasi-Newton Methods for Markov Chain Monte Carlo NIPS 2011
Periodic Step Size Adaptation for Single Pass On-line Learning NIPS 2009