Skip to content
conftrace_

int4 quantization

4 papers

Explore in graph

Also known as

INT4

Co-occurring keywords · papers mentioning both

fp8 quantization (2) inference acceleration (2) model compression (2) int8 quantization (1) channel-wise outlier (1) outlier smoothing (1) two-level accumulation (1) activation smoothing (1) llm quantization (1) transformer model (1)

Papers

“Give Me BF16 or Give Me Death”? Accuracy-Performance Trade-Offs in LLM Quantization ACL 2025 Rotated Runtime Smooth: Training-Free Activation Smoother for accurate INT4 inference ICLR 2025 SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantization ICML 2025 Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023