Rohan Anil
11 papers · 2018–2024 · 5 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+5 more ↓ Show less ↑
π£ Hot Topic Early Bird π Conference Polyglot Β· Silver π Academic Marathon Β· Sprint π Interdisciplinary Bridge Β· Bronze πΊοΈ Taxonomy Completionist (24)
π
Keyword Champion
(2)
ποΈ
Keyword Collector
(52)
π
Century Club Β· Bronze
π₯
Unstoppable Β· Bronze
π
Conference Pioneer
Top co-authors
Research topics
Machine Learning
(10)
Deep Learning
(7)
Optimization & Theory Β· Machine Learning
(7)
Learning Types
(4)
Application Areas
(3)
Computer Vision
(2)
Mathematics & Optimization
(2)
Core AI Β· Computer Vision
(2)
Optimization
(2)
Optimization & Theory Β· Deep Learning
(2)
Techniques
(2)
Artificial Intelligence
(1)
Security & Privacy
(1)
Analysis
(1)
Core AI Β· Artificial Intelligence
(1)
Keywords
stochastic gradient descent
(4)
bregman divergence
(2)
second-order optimization
(2)
adaptive regularization
(2)
neural network training
(2)
stochastic optimization
(2)
neural network
(2)
computer vision
(2)
knowledge distillation
(2)
language modeling
(2)
online convex optimization
(2)
deep learning
(1)
bert model
(1)
neural network optimization
(1)
convergence analysis
(1)
transfer learning
(1)
distributed training
(1)
multi-task learning
(1)
gradient descent
(1)
convex optimization
(1)
Papers
Combining Axes Preconditioners through Kronecker Approximation for Deep Learning
ICLR 2024
A Computationally Efficient Sparsified Online Newton Method
NeurIPS 2023
Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions
NeurIPS 2023
Knowledge Distillation: A Good Teacher Is Patient and Consistent
CVPR 2022
Large-Scale Differentially Private BERT
EMNLP 2022
LocoProp: Enhancing BackProp via Local Loss Optimization
AISTATS 2022
Efficiently Identifying Task Groupings for Multi-Task Learning
NeurIPS 2021
Stochastic Optimization with Laggard Data Pipelines
NeurIPS 2020
Memory Efficient Adaptive Optimization
NeurIPS 2019
Robust Bi-Tempered Logistic Loss Based on Bregman Divergences
NeurIPS 2019
Large scale distributed neural network training through online distillation
ICLR 2018