Lorenzo Noci
13 papers · 2021–2025 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
π Cross-Pollinator (6) π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (5) πΊοΈ Taxonomy Completionist (25)
πΊοΈ
Taxonomy Completionist
(25)
π€
Dynamic Duo
(11)
β
The Questioner
π₯
Unstoppable
(5)
ποΈ
Keyword Collector
(50)
π
Century Club
(13)
Conferences
NIPS (7)
ICLR (2)
ICML (2)
AISTATS (1)
CVPR (1)
Top co-authors
Keywords
bayesian neural network
(3)
transformer architecture
(2)
cold posterior effect
(2)
data augmentation
(2)
catastrophic forgetting
(1)
feature learning
(1)
model quantization
(1)
network architecture
(1)
continual learning
(1)
attention mechanism
(1)
knowledge distillation
(1)
self-attention mechanism
(1)
hyperparameter transfer
(1)
network dynamics
(1)
loss landscape
(1)
neural network optimization
(1)
covariance matrix
(1)
model pruning
(1)
gaussian priors
(1)
autoregressive transformer
(1)
Papers
The Importance of Being Lazy: Scaling Limits of Continual Learning
ICML 2025
Super Consistency of Neural Network Landscapes and Learning Rate Transfer
NIPS 2024
Understanding and Minimising Outlier Features in Transformer Training
NIPS 2024
How Good is a Single Basin?
AISTATS 2024
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit
ICLR 2024
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers
NIPS 2023
Achieving a Better Stability-Plasticity Trade-Off via Auxiliary Networks in Continual Learning
CVPR 2023
The Curious Case of Benign Memorization
ICLR 2023
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit
NIPS 2023
How Tempering Fixes Data Augmentation in Bayesian Neural Networks
ICML 2022
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse
NIPS 2022
Precise characterization of the prior predictive distribution of deep ReLU networks
NIPS 2021
Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect
NIPS 2021