kronecker factorization

Fast and Accurate Fisher-Guided Quantization via Efficient Kronecker Factorization ACL 2026 Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks NeurIPS 2024 The LLM Surgeon ICLR 2024 Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation ICLR 2023 Learning to Grow Pretrained Models for Efficient Transformer Training ICLR 2023 MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates NeurIPS 2023 Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions NeurIPS 2023 A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021 LQF: Linear Quadratic Fine-Tuning CVPR 2021 Second-Order Neural ODE Optimizer NeurIPS 2021 SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021 Inefficiency of K-FAC for Large Batch Size Training AAAI 2020 Practical Quasi-Newton Methods for Training Deep Neural Networks NeurIPS 2020 EA-CG: An Approximate Second-Order Method for Training Fully-Connected Neural Networks AAAI 2019 Large-Scale Distributed Second-Order Optimization Using Kronecker-Factored Approximate Curvature for Deep Convolutional Neural Networks CVPR 2019 Approximating Real-Time Recurrent Learning with Random Kronecker Factors NeurIPS 2018 A Scalable Laplace Approximation for Neural Networks ICLR 2018 Fast Approximate Natural Gradient Descent in a Kronecker Factored Eigenbasis NeurIPS 2018 Kronecker-factored Curvature Approximations for Recurrent Neural Networks ICLR 2018 Kronecker Recurrent Units ICML 2018 Online Structured Laplace Approximations for Overcoming Catastrophic Forgetting NeurIPS 2018 A Kronecker-factored approximate Fisher matrix for convolution layers ICML 2016 Optimizing Neural Networks with Kronecker-factored Approximate Curvature ICML 2015