Stanislaw Jastrzebski
7 papers · 2018–2022 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+3 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (11) π£ Hot Topic Early Bird π§ Keyword Pioneer π Conference Polyglot (5) π Interdisciplinary Bridge
π
Cross-Pollinator
(13)
π₯
Unstoppable
(5)
β
The Questioner
(2)
Conferences
ICML (3)
ACL (1)
ICLR (1)
NAACL (1)
NIPS (1)
Top co-authors
Keywords
model compression
(1)
representation learning
(1)
stochastic gradient descent
(1)
transfer learning
(1)
text classification
(1)
knowledge mining
(1)
commonsense knowledge
(1)
multi-modal learning
(1)
neural network optimization
(1)
loss landscape
(1)
novelty detection
(1)
fisher information matrix
(1)
high dimensional optimization
(1)
knowledge base completion
(1)
learning rate
(1)
deep neural network
(1)
implicit regularization
(1)
modality imbalance
(1)
mode connectivity
(1)
parameter efficiency
(1)
Papers
Characterizing and Overcoming the Greedy Nature of Learning in Multi-modal Deep Neural Networks
ICML 2022
Catastrophic Fisher Explosion: Early Phase Fisher Matrix Impacts Generalization
ICML 2021
The Break-Even Point on Optimization Trajectories of Deep Neural Networks
ICLR 2020
Can Wikipedia Categories Improve Masked Language Model Pretraining?
ACL 2020
Parameter-Efficient Transfer Learning for NLP
ICML 2019
Large Scale Structure of Neural Network Loss Landscapes
NIPS 2019
Commonsense mining as knowledge base completion? A study on the impact of novelty
NAACL 2018