conftrace_

natural gradient descent

17 papers

Explore in graph

Also known as

NGD

Co-occurring keywords

second-order optimization (93) fisher information matrix (46) natural gradient (75) neural network optimization (1293) mirror descent (148) optimization algorithm (148) fisher information (106) convex optimization (1321) variational inference (2069) neural network training (309)

Papers

Beyond the Mean: Fisher-Orthogonal Projection for Natural Gradient Descent in Large Batch Training AAAI 2026
A Sample-Level Evaluation and Generative Framework for Model Inversion Attacks AAAI 2025
An Improved Empirical Fisher Approximation for Natural Gradient Descent NIPS 2024
Near-Optimal Convex Simple Bilevel Optimization with a Bisection Method AISTATS 2024
A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NIPS 2024
Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023
Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent AISTATS 2021
Tractable structured natural-gradient descent using local parameterizations ICML 2021
THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021
Dual Parameterization of Sparse Variational Gaussian Processes NIPS 2021
Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks NIPS 2020
Towards Query-Efficient Black-Box Adversary with Zeroth-Order Natural Gradient Descent AAAI 2020
Curvature-corrected learning dynamics in deep neural networks ICML 2020
Limitations of the empirical Fisher approximation for natural gradient descent NIPS 2019
Natural Neural Networks NIPS 2015
Projected Natural Actor-Critic NIPS 2013
Topmoumoute Online Natural Gradient Algorithm NIPS 2007