Josh Alman
6 papers · 2023–2025 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+2 more ↓ Show less ↑
π Cross-Pollinator (12) π Interdisciplinary Bridge π Conference Polyglot (2) π§ Keyword Pioneer π Renaissance Researcher (5)
πΊοΈ
Taxonomy Completionist
(17)
β
The Questioner
Conferences
NIPS (4)
ICLR (2)
Top co-authors
Keywords
computational complexity
(2)
attention mechanism
(2)
neural network optimization
(1)
efficient computing
(1)
theoretical analysis
(1)
fine-grained complexity
(1)
computational efficiency
(1)
training optimization
(1)
gradient computation
(1)
low rank matrix
(1)
low rank approximation
(1)
algorithm complexity
(1)
complexity bound
(1)
matrix computation
(1)
linear algebra
(1)
preprocessing algorithm
(1)
positive definite kernel
(1)
manhattan distance
(1)
attention network
(1)
kernel methods
(1)
Papers
Fundamental Limitations on Subquadratic Alternatives to Transformers
ICLR 2025
Metric Transforms and Low Rank Representations of Kernels for Fast Attention
NIPS 2024
The Fine-Grained Complexity of Gradient Computation for Training Large Language Models
NIPS 2024
How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation
ICLR 2024
Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing
NIPS 2023
Fast Attention Requires Bounded Entries
NIPS 2023