conftrace_

weight activation quantization

3 papers

Explore in graph

Co-occurring keywords

large language model (13587) model compression (3302) activation quantization (49) weight quantization (137) model quantization (281) outlier mitigation (3) rotation transformation (3) rotation matrix (11) activation outlier (11) activation outlier smoothing (1)

Papers

DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs NIPS 2024
ATQ: Activation Transformation forWeight-Activation Quantization of Large Language Models EMNLP 2024
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023