Shankar Krishnan
6 papers · 2018–2024 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
🌍 Conference Polyglot · Bronze 🏃 Academic Marathon · Sprint 🌉 Interdisciplinary Bridge · Bronze 🗺️ Taxonomy Completionist (17) 🐣 Hot Topic Early Bird
🚀
Conference Pioneer
Venues
Top co-authors
Research topics
Machine Learning
(6)
Optimization & Theory · Machine Learning
(6)
Deep Learning
(3)
Artificial Intelligence
(2)
Learning Types · Deep Learning
(2)
Optimization & Theory · Deep Learning
(2)
Natural Language Processing
(1)
Architectures
(1)
Core AI
(1)
Generation
(1)
Learning Paradigms · Machine Learning
(1)
Learning Paradigms · Artificial Intelligence
(1)
Learning Types · Machine Learning
(1)
Models
(1)
Techniques
(1)
Keywords
neural network optimization
(2)
language model
(2)
batch normalization
(2)
deep neural network
(2)
few-shot learning
(1)
transfer learning
(1)
natural language processing
(1)
model pretraining
(1)
deep learning
(1)
gradient descent
(1)
inductive bia
(1)
hessian eigenvalue
(1)
gradient flow
(1)
model training
(1)
implicit bia
(1)
linear neural network
(1)
normalization layer
(1)
reasoning ability
(1)
singular vector
(1)
gradual stacking
(1)
Papers
On the Inductive Bias of Stacking Towards Improving Reasoning
NeurIPS 2024
Efficient Training of Language Models using Few-Shot Learning
ICML 2023
A unifying view on implicit bias in training linear neural networks
ICLR 2021
Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Networks
CVPR 2020
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density
ICML 2019
Neumann Optimizer: A Practical Optimization Algorithm for Deep Neural Networks
ICLR 2018