Huiyin Xue
5 papers · 2022–2025 · 4 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
π
Interdisciplinary Bridge
π§
Keyword Pioneer
π
Conference Polyglot
(4)
π
Cross-Pollinator
(12)
πΊοΈ
Taxonomy Completionist
(19)
Conferences
EMNLP (2)
AACL (1)
ACL (1)
IJCNLP (1)
Top co-authors
Keywords
attention mechanism
(3)
language model
(3)
parameter efficiency
(2)
model architecture
(2)
neural network optimization
(2)
model compression
(2)
semantic matching
(1)
locality-sensitive hashing
(1)
memory efficiency
(1)
token prediction
(1)
transformer optimization
(1)
speculative decoding
(1)
memory footprint
(1)
multi-head attention
(1)
semantic retrieval
(1)
pre-trained transformer
(1)
approximate nearest neighbour search
(1)
model deconstruction
(1)
large language model
(1)
token generation
(1)
Papers
Deconstructing Attention: Investigating Design Principles for Effective Language Modeling
AACL 2025
DReSD: Dense Retrieval for Speculative Decoding
ACL 2025
Deconstructing Attention: Investigating Design Principles for Effective Language Modeling
IJCNLP 2025
Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention
EMNLP 2023
HashFormers: Towards Vocabulary-independent Pre-trained Transformers
EMNLP 2022