natural gradient descent

Beyond the Mean: Fisher-Orthogonal Projection for Natural Gradient Descent in Large Batch Training AAAI 2026 A Sample-Level Evaluation and Generative Framework for Model Inversion Attacks AAAI 2025 Guiding Time-Varying Generative Models with Natural Gradients on Exponential Family Manifold UAI 2025 Wasserstein Gradient Flow over Variational Parameter Space for Variational Inference AISTATS 2025 A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NeurIPS 2024 An Improved Empirical Fisher Approximation for Natural Gradient Descent NeurIPS 2024 Near-Optimal Convex Simple Bilevel Optimization with a Bisection Method AISTATS 2024 Structured Inverse-Free Natural Gradient Descent: Memory-Efficient & Numerically-Stable KFAC ICML 2024 Achieving High Accuracy with PINNs via Energy Natural Gradient Descent ICML 2023 Dual Parameterization of Sparse Variational Gaussian Processes NeurIPS 2021 Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent AISTATS 2021 THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021 Tractable structured natural-gradient descent using local parameterizations ICML 2021 When does preconditioning help or hurt generalization? ICLR 2021 Curvature-corrected learning dynamics in deep neural networks ICML 2020 Towards Query-Efficient Black-Box Adversary with Zeroth-Order Natural Gradient Descent AAAI 2020 Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks NeurIPS 2020 Limitations of the empirical Fisher approximation for natural gradient descent NeurIPS 2019 Natural Neural Networks NeurIPS 2015 Projected Natural Actor-Critic NeurIPS 2013 Topmoumoute Online Natural Gradient Algorithm NeurIPS 2007