conftrace_

fisher information matrix

46 papers

Explore in graph

Also known as

FIM

Co-occurring keywords

natural gradient (75) second-order optimization (93) neural network optimization (1293) fisher information (106) natural gradient descent (17) stochastic gradient descent (1091) deep neural network (1803) neural network training (309) eigenvalue spectrum (7) kronecker factorization (18)

Papers

Regularising Fisher Information Improves Cross-lingual Generalisation EMNLP 2021
THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021
Tractable structured natural-gradient descent using local parameterizations ICML 2021
The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry AISTATS 2021
CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks NIPS 2021
New Insights and Perspectives on the Natural Gradient Method JMLR 2020
Limitations of the empirical Fisher approximation for natural gradient descent NIPS 2019
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach AISTATS 2019
Natural Option Critic AAAI 2019
The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks NIPS 2019
Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019
Numerical Analysis near Singularities in RBF Networks JMLR 2018
The Spectrum of the Fisher Information Matrix of a Single-Hidden-Layer Neural Network NIPS 2018
EigenNet: Towards Fast and Structural Learning of Deep Neural Networks IJCAI 2017
Energetic Natural Gradient Descent ICML 2016
Optimizing Neural Networks with Kronecker-factored Approximate Curvature ICML 2015
GeNGA: A Generalization of Natural Gradient Ascent with Positive and Negative Convergence Results ICML 2014
Deep Learning Made Easier by Linear Transformations in Perceptrons AISTATS 2012
Automatic Calibration of Multiple Coplanar Sensors RSS 2011
Natural Policy Gradient Methods with Parameter-based Exploration for Control Tasks NIPS 2010
A Generalized Natural Actor-Critic Algorithm NIPS 2009