Huiyin Xue
4 papers · 2022–2025 · 3 venues · across top CS/AI venues
Authors are matched by name, so researchers who share a name ("Yang Liu", "Wei Wang") appear as a single profile and their paper counts, venues and achievements are combined. How identity is handled.
Achievements
Jump to papers ↓
🌍
Conference Polyglot · Bronze
🌉
Interdisciplinary Bridge · Bronze
🗺️
Taxonomy Completionist
(18)
Venues
Top co-authors
Research topics
Deep Learning
(4)
Machine Learning
(4)
Architectures
(3)
Artificial Intelligence
(2)
Natural Language Processing
(2)
Application Areas
(2)
Core AI
(2)
Core Methods
(2)
Generation
(2)
Optimization & Theory · Deep Learning
(2)
Techniques
(2)
Applications
(1)
Learning Types
(1)
Models
(1)
Optimization & Theory · Machine Learning
(1)
Keywords
parameter efficiency
(2)
attention mechanism
(2)
language model
(2)
model compression
(2)
language modeling
(1)
model architecture
(1)
neural network optimization
(1)
dense retrieval
(1)
semantic matching
(1)
locality sensitive hashing
(1)
memory efficiency
(1)
token prediction
(1)
transformer optimization
(1)
speculative decoding
(1)
memory footprint
(1)
multi-head attention
(1)
semantic retrieval
(1)
pre-trained transformer
(1)
approximate nearest neighbour search
(1)
model deconstruction
(1)
Papers
Deconstructing Attention: Investigating Design Principles for Effective Language Modeling
IJCNLP 2025
DReSD: Dense Retrieval for Speculative Decoding
ACL 2025
Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention
EMNLP 2023
HashFormers: Towards Vocabulary-independent Pre-trained Transformers
EMNLP 2022