conftrace_

fisher information matrix

46 papers

Explore in graph

Also known as

FIM

Co-occurring keywords

natural gradient (75) second-order optimization (93) neural network optimization (1293) fisher information (106) natural gradient descent (17) stochastic gradient descent (1091) deep neural network (1803) neural network training (309) eigenvalue spectrum (7) kronecker factorization (18)

Papers

Beyond Variance: Knowledge-Aware LLM Compression via Fisher-Aligned Subspace Diagnostics ACL 2026
Lark: Low-Rank Updates After Knowledge Localization for Few-shot Class-Incremental Learning ICCV 2025
Graceful Forgetting in Generative Language Models EMNLP 2025
FIMA-Q: Post-Training Quantization for Vision Transformers by Fisher Information Matrix Approximation CVPR 2025
FisherTune: Fisher-Guided Robust Tuning of Vision Foundation Models for Domain Generalized Segmentation CVPR 2025
DIDS: Domain Impact-aware Data Sampling for Large Language Model Training EMNLP 2025
Sketched Lanczos uncertainty score: a low-memory summary of the Fisher information NIPS 2024
Trade-Offs of Diagonal Fisher Information Matrix Estimators NIPS 2024
Conditions for parameter unidentifiability of linear ARX systems for enhancing security L4DC 2024
An Improved Empirical Fisher Approximation for Natural Gradient Descent NIPS 2024
A Layer-Wise Natural Gradient Optimizer for Training Deep Neural Networks NIPS 2024
RRL: Recommendation Reverse Learning AAAI 2024
Uncertainty Estimation by Fisher Information-based Evidential Deep Learning ICML 2023
Efficient preconditioned stochastic gradient descent for estimation in latent variable models ICML 2023
Clustering Pseudo Language Family in Multilingual Translation Models with Fisher Information Matrix EMNLP 2023
Inverse-Reference Priors for Fisher Regularization of Bayesian Neural Networks AAAI 2023
Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime NIPS 2022
Does the Geometry of the Data Control the Geometry of Neural Predictions? (Student Abstract) AAAI 2022
Does the Data Induce Capacity Control in Deep Learning? ICML 2022
Seizing Critical Learning Periods in Federated Learning AAAI 2022
On the Variance of the Fisher Information for Deep Learning NIPS 2021
Sketching curvature for efficient out-of-distribution detection for deep neural networks UAI 2021
SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature CVPR 2021
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization ICML 2021
A Trace-restricted Kronecker-Factored Approximation to Natural Gradient AAAI 2021