Alliot Nagle
5 papers · 2020–2025 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓+1 more ↓ Show less ↑
π Interdisciplinary Bridge π§ Keyword Pioneer π Conference Polyglot (2) π Academic Marathon (5) π Cross-Pollinator (11)
πΊοΈ
Taxonomy Completionist
(17)
Conferences
NIPS (4)
ICLR (1)
Top co-authors
Keywords
neural network pruning
(2)
lottery ticket hypothesis
(2)
network pruning
(1)
efficient inference
(1)
markov chain
(1)
rate distortion
(1)
learning dynamics
(1)
next-token prediction
(1)
sparse training
(1)
parameter initialization
(1)
global minimum
(1)
prompt compression
(1)
token-level compression
(1)
black-box model
(1)
relu network
(1)
rate-distortion theory
(1)
local minimum
(1)
network compression
(1)
large language model
(1)
transformer model
(1)
Papers
Attention with Markov: A Curious Case of Single-layer Transformers
ICLR 2025
Local to Global: Learning Dynamics and Effect of Initialization for Transformers
NIPS 2024
Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models
NIPS 2024
Rare Gems: Finding Lottery Tickets at Initialization
NIPS 2022
Optimal Lottery Tickets via Subset Sum: Logarithmic Over-Parameterization is Sufficient
NIPS 2020