conftrace_

large language model quantization

4 papers

Explore in graph

Also known as

LLM QUANTIZATION

Co-occurring keywords · papers mentioning both

model compression (4) large language model (3) model quantization (3) bit precision (1) accuracy recovery (1) llm quantization (1) distribution fitting (1) int4 quantization (1) deployment efficiency (1) pivot token (1)

Papers

“Give Me BF16 or Give Me Death”? Accuracy-Performance Trade-Offs in LLM Quantization ACL 2025 One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments ACL 2025 OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fitting ICLR 2025 IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact ACL 2024