natural gradient

The Variational Predictive Natural Gradient ICML 2019 Accelerating Natural Gradient with Higher-Order Invariance ICML 2018 Characterizing Implicit Bias in Terms of Optimization Geometry ICML 2018 Combining Natural Gradient with Hessian Free Methods for Sequence Training Interspeech 2018 Exact natural gradient in deep linear networks and its application to the nonlinear case NeurIPS 2018 Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam ICML 2018 Fast Approximate Natural Gradient Descent in a Kronecker Factored Eigenbasis NeurIPS 2018 Natural Gradients in Practice: Non-Conjugate Variational Inference in Gaussian Process Models AISTATS 2018 Noisy Natural Gradient as Variational Inference ICML 2018 Orthogonally Decoupled Variational Gaussian Processes NeurIPS 2018 SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient NeurIPS 2018 Variational Message Passing with Structured Inference Networks ICLR 2018 Distributed Bayesian Learning with Stochastic Natural Gradient Expectation Propagation and the Posterior Server JMLR 2017 Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles JMLR 2017 Relative Fisher Information and Natural Gradient for Learning Large Modular Models ICML 2017 A Kronecker-factored approximate Fisher matrix for convolution layers ICML 2016 Approximate Newton Methods for Policy Search in Markov Decision Processes JMLR 2016 Bayesian Policy Gradient and Actor-Critic Algorithms JMLR 2016 d-VMP: Distributed Variational Message Passing PGM 2016 Energetic Natural Gradient Descent ICML 2016 How to Center Deep Boltzmann Machines JMLR 2016 Kullback-Leibler Proximal Variational Inference NeurIPS 2015 Optimizing Neural Networks with Kronecker-factored Approximate Curvature ICML 2015 Scaling up Natural Gradient by Sparsely Factorizing the Inverse Fisher Matrix ICML 2015 Natural Evolution Strategies JMLR 2014