Co-occurring keywords
Papers
Enhancing Computation Efficiency in Large Language Models through Weight and Activation Quantization
EMNLP 2023
Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization
INTERSPEECH 2022
Squashed Weight Distribution for Low Bit Quantization of Deep Models
INTERSPEECH 2022
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
NIPS 2022
Mr.BiQ: Post-Training Non-Uniform Quantization Based on Minimizing the Reconstruction Error
CVPR 2022