Ashok Vardhan Makkuva
6 papers · 2023–2025 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (3) π Cross-Pollinator (11) π Renaissance Researcher (5)
πΊοΈ
Taxonomy Completionist
(18)
Conferences
NIPS (3)
ICML (2)
ICLR (1)
Top co-authors
Keywords
information theory
(1)
sequence modeling
(1)
curriculum learning
(1)
attention mechanism
(1)
in-context learning
(1)
efficient inference
(1)
markov chain
(1)
rate distortion
(1)
learning dynamics
(1)
next-token prediction
(1)
parameter initialization
(1)
global minimum
(1)
prompt compression
(1)
token-level compression
(1)
black-box model
(1)
layer normalization
(1)
markov process
(1)
rate-distortion theory
(1)
local minimum
(1)
neural decoder
(1)
Papers
Attention with Markov: A Curious Case of Single-layer Transformers
ICLR 2025
Local to Global: Learning Dynamics and Effect of Initialization for Transformers
NIPS 2024
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
NIPS 2024
Transformers on Markov data: Constant depth suffices
NIPS 2024
LASER: Linear Compression in Wireless Distributed Optimization
ICML 2024
CRISP: Curriculum based Sequential neural decoders for Polar code family
ICML 2023