Skip to content
conftrace_

fisher matrix

6 papers

Explore in graph

Co-occurring keywords · papers mentioning both

second-order optimization (4) natural gradient (3) second-order method (2) kronecker product (2) gradient preconditioning (1) block-diagonal preconditioning (1) neural network (1) kronecker factorization (1) second-order optimizer (1) empirical fisher (1)

Papers

A Mini-Block Fisher Method for Deep Neural Networks AISTATS 2023 KrADagrad: Kronecker approximation-domination gradient preconditioned stochastic optimization UAI 2023 Tensor Normal Training for Deep Learning Models NeurIPS 2021 A Kronecker-factored approximate Fisher matrix for convolution layers ICML 2016 Natural Neural Networks NeurIPS 2015 Scaling up Natural Gradient by Sparsely Factorizing the Inverse Fisher Matrix ICML 2015