Soufiane Hayou
12 papers · 2019–2025 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
π Interdisciplinary Bridge π Cross-Pollinator (15) π§ Keyword Pioneer π Conference Polyglot (5) π Academic Marathon (6)
πΊοΈ
Taxonomy Completionist
(12)
π
Triple Crown
π₯
Unstoppable
(5)
π
Century Club
(12)
β‘
Prolific Year
(5)
Conferences
ICLR (4)
ICML (4)
NIPS (2)
AISTATS (1)
JMLR (1)
Top co-authors
Keywords
neural network optimization
(3)
deep neural network
(3)
signal propagation
(2)
residual network
(2)
infinite depth limit
(2)
learning rate
(1)
gaussian distribution
(1)
weight initialization
(1)
activation function
(1)
bayesian deep learning
(1)
skip connection
(1)
infinite width
(1)
infinite width limit
(1)
gradient propagation
(1)
residual neural network
(1)
stochastic depth
(1)
resnet architecture
(1)
infinite-width limit
(1)
edge of chao
(1)
low rank adaptation
(1)
Papers
Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory
ICLR 2025
The Impact of Initialization on LoRA Finetuning Dynamics
NIPS 2024
Commutative Scaling of Width and Depth in Deep Neural Networks
JMLR 2024
Tensor Programs VI: Feature Learning in Infinite Depth Neural Networks
ICLR 2024
Leave-one-out Distinguishability in Machine Learning
ICLR 2024
LoRA+: Efficient Low Rank Adaptation of Large Models
ICML 2024
Width and Depth Limits Commute in Residual Networks
ICML 2023
Feature Learning and Signal Propagation in Deep Neural Networks
ICML 2022
Stable ResNet
AISTATS 2021
Robust Pruning at Initialization
ICLR 2021
Regularization in ResNet with Stochastic Depth
NIPS 2021
On the Impact of the Activation function on Deep Neural Networks Training
ICML 2019