Rohan Anil
11 papers · 2018–2024 · 5 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
π Interdisciplinary Bridge π Conference Polyglot (5) π Academic Marathon (6) π Renaissance Researcher (6) πΊοΈ Taxonomy Completionist (25)
π
Academic Marathon
(6)
π
Renaissance Researcher
(6)
π
Interdisciplinary Bridge
π
Century Club
(11)
π₯
Unstoppable
(7)
π
Conference Pioneer
Conferences
NIPS (6)
ICLR (2)
AISTATS (1)
CVPR (1)
EMNLP (1)
Top co-authors
Research topics
Keywords
stochastic gradient descent
(3)
second-order optimization
(2)
online convex optimization
(2)
neural network training
(2)
bregman divergence
(2)
computer vision
(2)
transfer learning
(1)
convergence analysis
(1)
stochastic optimization
(1)
language modeling
(1)
knowledge distillation
(1)
bert model
(1)
neural network optimization
(1)
multi-task learning
(1)
adaptive regularization
(1)
gradient descent
(1)
convex optimization
(1)
logistic loss
(1)
differential privacy
(1)
model compression
(1)
Papers
Combining Axes Preconditioners through Kronecker Approximation for Deep Learning
ICLR 2024
Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions
NIPS 2023
A Computationally Efficient Sparsified Online Newton Method
NIPS 2023
LocoProp: Enhancing BackProp via Local Loss Optimization
AISTATS 2022
Large-Scale Differentially Private BERT
EMNLP 2022
Knowledge Distillation: A Good Teacher Is Patient and Consistent
CVPR 2022
Efficiently Identifying Task Groupings for Multi-Task Learning
NIPS 2021
Stochastic Optimization with Laggard Data Pipelines
NIPS 2020
Robust Bi-Tempered Logistic Loss Based on Bregman Divergences
NIPS 2019
Memory Efficient Adaptive Optimization
NIPS 2019
Large scale distributed neural network training through online distillation
ICLR 2018