Mihai Nica
6 papers · 2020–2024 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot (3) 🌉 Interdisciplinary Bridge 🧭 Keyword Pioneer 🐝 Cross-Pollinator (14) 🏆 Keyword Champion (3)
🔥
Unstoppable
(5)
Conferences
ICLR (3)
NIPS (2)
JMLR (1)
Top co-authors
Keywords
neural network initialization
(3)
gaussian process
(1)
stochastic differential equation
(1)
activation function
(1)
residual network
(1)
random matrix
(1)
relu network
(1)
infinite width
(1)
infinite width limit
(1)
network initialization
(1)
monte carlo
(1)
infinite-width network
(1)
neural network
(1)
depth degeneracy
(1)
angle collapse
(1)
neural network theory
(1)
combinatorial expansion
(1)
Papers
Dynamic Sparse Training with Structured Sparsity
ICLR 2024
Depth Degeneracy in Neural Networks: Vanishing Angles in Fully Connected ReLU Networks on Initialization
JMLR 2024
The Tilted Variational Autoencoder: Improving Out-of-Distribution Detection
ICLR 2023
The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization
NIPS 2022
The future is log-Gaussian: ResNets and their infinite-depth-and-width limit at initialization
NIPS 2021
Finite Depth and Width Corrections to the Neural Tangent Kernel
ICLR 2020