Marco Bondaschi
5 papers · 2024–2025 · 3 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
π
Interdisciplinary Bridge
π§
Keyword Pioneer
π
Conference Polyglot
(3)
π
Cross-Pollinator
(11)
πΊοΈ
Taxonomy Completionist
(14)
Conferences
NIPS (3)
ICLR (1)
ICML (1)
Top co-authors
Keywords
information theory
(1)
sequence modeling
(1)
attention mechanism
(1)
in-context learning
(1)
efficient inference
(1)
markov chain
(1)
rate distortion
(1)
learning dynamics
(1)
next-token prediction
(1)
parameter initialization
(1)
global minimum
(1)
prompt compression
(1)
token-level compression
(1)
black-box model
(1)
layer normalization
(1)
markov process
(1)
rate-distortion theory
(1)
local minimum
(1)
large language model
(1)
transformer model
(1)
Papers
Attention with Markov: A Curious Case of Single-layer Transformers
ICLR 2025
Local to Global: Learning Dynamics and Effect of Initialization for Transformers
NIPS 2024
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
NIPS 2024
Transformers on Markov data: Constant depth suffices
NIPS 2024
LASER: Linear Compression in Wireless Distributed Optimization
ICML 2024