Huihong Shi
3 papers · 2023–2024 · 2 conferences · across top CS/AI conferences
Achievements
Jump to papers ↓
π
Interdisciplinary Bridge
π§
Keyword Pioneer
π
Conference Polyglot
(2)
π
Cross-Pollinator
(10)
πΊοΈ
Taxonomy Completionist
(10)
Conferences
NIPS (2)
ICML (1)
Top co-authors
Keywords
model compression
(2)
vision transformer
(1)
attention mechanism
(1)
efficient computing
(1)
mixture of expert
(1)
weight quantization
(1)
latency reduction
(1)
inference acceleration
(1)
multiplication-free model
(1)
hardware acceleration
(1)
bit allocation
(1)
large language model
(1)
multiplication reduction
(1)
shift-add reparameterization
(1)
shift-and-add reparameterization
(1)
Papers
ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
NIPS 2024
Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration
ICML 2024
ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
NIPS 2023