fisher information matrix

Clustering Pseudo Language Family in Multilingual Translation Models with Fisher Information Matrix EMNLP 2023 Disentangling the Mechanisms Behind Implicit Regularization in SGD ICLR 2023 Efficient preconditioned stochastic gradient descent for estimation in latent variable models ICML 2023 Fisher-Legendre (FishLeg) optimization of deep neural networks ICLR 2023 Inverse-Reference Priors for Fisher Regularization of Bayesian Neural Networks AAAI 2023 Uncertainty Estimation by Fisher Information-based Evidential Deep Learning ICML 2023 Does the Data Induce Capacity Control in Deep Learning? ICML 2022 Does the Geometry of the Data Control the Geometry of Neural Predictions? (Student Abstract) AAAI 2022 Seizing Critical Learning Periods in Federated Learning AAAI 2022 Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime NeurIPS 2022 A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021 CAM-GAN: Continual Adaptation Modules for Generative Adversarial Networks NeurIPS 2021 Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization ICML 2021 On the Variance of the Fisher Information for Deep Learning NeurIPS 2021 Regularising Fisher Information Improves Cross-lingual Generalisation EMNLP 2021 Sketching curvature for efficient out-of-distribution detection for deep neural networks UAI 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 The Spectrum of Fisher Information of Deep Networks Achieving Dynamical Isometry AISTATS 2021 THOR, Trace-based Hardware-driven Layer-Oriented Natural Gradient Descent Computation AAAI 2021 Tractable structured natural-gradient descent using local parameterizations ICML 2021 Information Geometry of Orthogonal Initializations and Training ICLR 2020 New Insights and Perspectives on the Natural Gradient Method JMLR 2020 Fisher Information and Natural Gradient Learning in Random Deep Networks AISTATS 2019 Limitations of the empirical Fisher approximation for natural gradient descent NeurIPS 2019 Natural Option Critic AAAI 2019