Abhishek Panigrahi
13 papers · 2019–2025 · 6 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+7 more ↓ Show less ↑
π Renaissance Researcher (5) π Interdisciplinary Bridge π Conference Polyglot (6) π Academic Marathon (6) πΊοΈ Taxonomy Completionist (24)
π
Conference Polyglot
(6)
π
Academic Marathon
(6)
π
Renaissance Researcher
(5)
β‘
Prolific Year
(5)
π
Century Club
(13)
π₯
Unstoppable
(7)
β
The Questioner
(2)
Conferences
ICML (5)
ICLR (3)
NIPS (2)
ACL (1)
EMNLP (1)
NAACL (1)
Top co-authors
Keywords
gradient descent
(2)
sequence modeling
(1)
sparse representation
(1)
few-shot learning
(1)
non-convex optimization
(1)
latent dirichlet allocation
(1)
continual learning
(1)
topic modeling
(1)
syntactic parsing
(1)
neural network optimization
(1)
loss landscape
(1)
transformer architecture
(1)
hidden state
(1)
long short-term memory
(1)
recurrent neural network
(1)
hessian eigenvalue
(1)
implicit regularization
(1)
parameter-efficient fine-tuning
(1)
stochastic differential equation
(1)
unsupervised learning
(1)
Papers
Representing Rule-based Chatbots with Transformers
NAACL 2025
Efficient stagewise pretraining via progressive subnetworks
ICLR 2025
Progressive distillation induces an implicit curriculum
ICLR 2025
Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
ICML 2025
On the Power of Context-Enhanced Learning in LLMs
ICML 2025
Trainable Transformer in Transformer
ICML 2024
Task-Specific Skill Localization in Fine-tuned Language Models
ICML 2023
Do Transformers Parse while Predicting the Masked Word?
EMNLP 2023
On the SDEs and Scaling Rules for Adaptive Gradient Algorithms
NIPS 2022
Understanding Gradient Descent on the Edge of Stability in Deep Learning
ICML 2022
Learning and Generalization in RNNs
NIPS 2021
Effect of Activation Functions on the Training of Overparametrized Neural Nets
ICLR 2020
Word2Sense: Sparse Interpretable Word Embeddings
ACL 2019