Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model

Kaiwen Tang; Zhanglu Yan; Weng-Fai Wong

2025 ICML ICML 2025

Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

Authors

Kaiwen Tang, Zhanglu Yan, Weng-Fai Wong

Topics

Machine Learning > Application Areas > Efficient Computing Deep Learning > Architectures > Transformers Artificial Intelligence > Core AI > Large Language Models

Keywords

model quantization knowledge distillation spiking neural network energy savings bitshifting-based powernorm ptsoftmax

Download PDF