conftrace_

natural gradient

75 papers

Explore in graph

Also known as

NG

Co-occurring keywords

variational inference (2069) second-order optimization (93) fisher information matrix (46) gaussian process (1200) gradient descent (1144) bayesian inference (1907) kronecker factorization (18) policy gradient (520) natural gradient descent (17) neural network optimization (1293)

Papers

New Insights and Perspectives on the Natural Gradient Method JMLR 2020
Handling the Positive-Definite Constraint in the Bayesian Learning Rule ICML 2020
Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020
Sinkhorn Natural Gradient for Generative Models NIPS 2020
Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations ICML 2019
Hill Climbing on Value Estimates for Search-control in Dyna IJCAI 2019
The Variational Predictive Natural Gradient ICML 2019
Natural Option Critic AAAI 2019
Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search ICML 2019
Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019
Efficient Gaussian Process Classification Using Pólya-Gamma Data Augmentation AAAI 2019
Limitations of the empirical Fisher approximation for natural gradient descent NIPS 2019
Fast Convergence of Natural Gradient Descent for Over-Parameterized Neural Networks NIPS 2019
Noisy Natural Gradient as Variational Inference ICML 2018
Combining Natural Gradient with Hessian Free Methods for Sequence Training INTERSPEECH 2018
Exact natural gradient in deep linear networks and its application to the nonlinear case NIPS 2018
Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam ICML 2018
SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient NIPS 2018
Orthogonally Decoupled Variational Gaussian Processes NIPS 2018
Characterizing Implicit Bias in Terms of Optimization Geometry ICML 2018
Fast Approximate Natural Gradient Descent in a Kronecker Factored Eigenbasis NIPS 2018
Natural Gradients in Practice: Non-Conjugate Variational Inference in Gaussian Process Models AISTATS 2018
Accelerating Natural Gradient with Higher-Order Invariance ICML 2018
Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles JMLR 2017
Distributed Bayesian Learning with Stochastic Natural Gradient Expectation Propagation and the Posterior Server JMLR 2017