conftrace_

curvature approximation

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

second-order optimization (5) kronecker factorization (4) fisher information matrix (4) natural gradient (3) neural network optimization (2) neural network training (2) kronecker-factored curvature (1) block-diagonal approximation (1) generalized gauss-newton (1) second-order optimizer (1)

Papers

Convolutions and More as Einsum: A Tensor Network Perspective with Advances for Second-Order Methods NeurIPS 2024 ISAAC Newton: Input-based Approximate Curvature for Newton's Method ICLR 2023 Gradient Descent on Neurons and its Link to Approximate Second-order Optimization ICML 2022 A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 BackPACK: Packing more into Backprop ICLR 2020 Modular Block-diagonal Curvature Approximations for Feedforward Architectures AISTATS 2020 Kronecker-factored Curvature Approximations for Recurrent Neural Networks ICLR 2018 Optimizing Neural Networks with Kronecker-factored Approximate Curvature ICML 2015