natural gradient

BaLeNAS: Differentiable Architecture Search via the Bayesian Learning Rule CVPR 2022 Generalized Natural Gradient Flows in Hidden Convex-Concave Games and GANs ICLR 2022 Natural gradient enables fast sampling in spiking neural networks NeurIPS 2022 Towards an Understanding of Default Policies in Multitask Policy Optimization AISTATS 2022 A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021 Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent AISTATS 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 Spatio-Temporal Variational Gaussian Processes NeurIPS 2021 Tensor Normal Training for Deep Learning Models NeurIPS 2021 Curvature-corrected learning dynamics in deep neural networks ICML 2020 Fractional Underdamped Langevin Dynamics: Retargeting SGD with Momentum under Heavy-Tailed Gradient Noise ICML 2020 Handling the Positive-Definite Constraint in the Bayesian Learning Rule ICML 2020 Kernelized Wasserstein Natural Gradient ICLR 2020 New Insights and Perspectives on the Natural Gradient Method JMLR 2020 NGBoost: Natural Gradient Boosting for Probabilistic Prediction ICML 2020 Sinkhorn Natural Gradient for Generative Models NeurIPS 2020 Adaptive Stochastic Natural Gradient Method for One-Shot Neural Architecture Search ICML 2019 Efficient Gaussian Process Classification Using Pólya-Gamma Data Augmentation AAAI 2019 Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations ICML 2019 Fast Convergence of Natural Gradient Descent for Over-Parameterized Neural Networks NeurIPS 2019 Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019 Hill Climbing on Value Estimates for Search-control in Dyna IJCAI 2019 Limitations of the empirical Fisher approximation for natural gradient descent NeurIPS 2019 Natural Option Critic AAAI 2019 Preconditioner on Matrix Lie Group for SGD ICLR 2019