Atri Rudra
17 papers · 2018–2025 · 3 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓+6 more ↓ Show less ↑
πΊοΈ Taxonomy Completionist (26) π Academic Marathon Β· Sprint π Conference Polyglot Β· Bronze π Interdisciplinary Bridge Β· Bronze π£ Hot Topic Early Bird
π
Triple Crown
π€
Dynamic Duo
(17)
β‘
Prolific Year Β· Productive
π
Century Club Β· Bronze
ποΈ
Keyword Collector
(75)
π₯
Unstoppable Β· Bronze
Venues
Top co-authors
Research topics
Machine Learning
(14)
Deep Learning
(12)
Application Areas
(8)
Architectures
(7)
Artificial Intelligence
(6)
Core AI
(6)
Optimization & Theory Β· Machine Learning
(6)
Techniques
(6)
Core Methods
(5)
Optimization & Theory Β· Deep Learning
(3)
Mathematics & Optimization
(2)
Natural Language Processing
(2)
Generation
(2)
Learning Types
(2)
Learning Paradigms
(1)
Keywords
attention mechanism
(5)
model compression
(4)
sequence model
(4)
state space model
(4)
language modeling
(4)
sequence modeling
(3)
structured matrix
(3)
parameter efficiency
(3)
neural network
(3)
linear attention
(2)
recurrent neural network
(2)
model architecture
(2)
sparse training
(2)
gated convolution
(2)
locality sensitive hashing
(1)
time series
(1)
low-rank approximation
(1)
computational efficiency
(1)
knowledge distillation
(1)
efficient computing
(1)
Papers
Towards Learning High-Precision Least Squares Algorithms with Sequence Models
ICLR 2025
Simple linear attention language models balance the recall-throughput tradeoff
ICML 2024
Zoology: Measuring and Improving Recall in Efficient Language Models
ICLR 2024
How to Train your HIPPO: State Space Models with Generalized Orthogonal Basis Projections
ICLR 2023
Hungry Hungry Hippos: Towards Language Modeling with State Space Models
ICLR 2023
Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions
NeurIPS 2023
Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture
NeurIPS 2023
Simple Hardware-Efficient Long Convolutions for Sequence Modeling
ICML 2023
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
NeurIPS 2022
Monarch: Expressive Structured Matrices for Efficient and Accurate Training
ICML 2022
Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models
ICLR 2022
Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space Layers
NeurIPS 2021
Scatterbrain: Unifying Sparse and Low-rank Attention
NeurIPS 2021
HiPPO: Recurrent Memory with Optimal Polynomial Projections
NeurIPS 2020
Kaleidoscope: An Efficient, Learnable Representation For All Structured Linear Maps
ICLR 2020
Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations
ICML 2019
Learning Compressed Transforms with Low Displacement Rank
NeurIPS 2018