Amirkeivan Mohtashami
7 papers · 2021–2025 · 4 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(13)
🐣
Hot Topic Early Bird
🔥
Unstoppable · Bronze
Venues
Top co-authors
Research topics
Machine Learning
(7)
Optimization & Theory · Machine Learning
(6)
Deep Learning
(4)
Natural Language Processing
(2)
Application Areas
(2)
Architectures
(2)
Techniques
(2)
Artificial Intelligence
(1)
Core AI
(1)
Generation
(1)
Learning Types
(1)
Optimization & Theory · Deep Learning
(1)
Resources & Methods
(1)
Keywords
stochastic gradient descent
(3)
memory efficiency
(2)
large language model
(2)
model compression
(2)
attention mechanism
(1)
distributed learning
(1)
neural network optimization
(1)
asynchronous optimization
(1)
learning rate
(1)
context length
(1)
inference optimization
(1)
global minimum
(1)
information flow
(1)
batch size
(1)
gradient staleness
(1)
chain of thought
(1)
neural network
(1)
asynchronous update
(1)
partial gradient
(1)
communication efficient training
(1)
Papers
CoTFormer: A Chain of Thought Driven Architecture with Budget-Adaptive Computation Cost at Inference
ICLR 2025
DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averaging
NeurIPS 2024
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs
NeurIPS 2024
Random-Access Infinite Context Length for Transformers
NeurIPS 2023
Special Properties of Gradient Descent with Large Learning Rates
ICML 2023
Masked Training of Neural Networks with Partial Gradients
AISTATS 2022
Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates
AISTATS 2021