Shun-ichi Amari
6 papers · 2003–2021 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🏃
Academic Marathon · Full
🗺️
Taxonomy Completionist
(10)
🐣
Hot Topic Early Bird
❓
The Questioner
Venues
Top co-authors
Research topics
Keywords
fisher information matrix
(3)
neural network optimization
(2)
batch normalization
(1)
loss landscape
(1)
natural gradient
(1)
probability distribution
(1)
natural gradient descent
(1)
generalization ability
(1)
maximum mean discrepancy
(1)
learning rate
(1)
deep neural network
(1)
bias-variance tradeoff
(1)
sinkhorn divergence
(1)
layer normalization
(1)
overparameterized regression
(1)
network width
(1)
geometric divergence
(1)
stochastic neurodynamical method
(1)
mean field theory
(1)
eigenvalue statistics
(1)
Papers
When does preconditioning help or hurt generalization?
ICLR 2021
Fisher Information and Natural Gradient Learning in Random Deep Networks
AISTATS 2019
Interpolating between Optimal Transport and MMD using Sinkhorn Divergences
AISTATS 2019
The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks
NeurIPS 2019
Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach
AISTATS 2019
Introduction to Special Issue on Independent Components Analysis
JMLR 2003