conftrace_

weight quantization

137 papers

Explore in graph

Also known as

WQ

Co-occurring keywords

model compression (3302) model quantization (281) large language model (13587) post-training quantization (131) neural network quantization (122) activation quantization (49) neural network optimization (1293) knowledge distillation (3725) binary neural network (75) inference optimization (219)

Papers

PTQ1.61: Push the Real Limit of Extremely Low-Bit Post-Training Quantization Methods for Large Language Models ACL 2025
Unifying Uniform and Binary-coding Quantization for Accurate Compression of Large Language Models ACL 2025
GenPTQ: Green Post-Training Quantization for Large-Scale ASR Models with Mixed-Precision Bit Allocation EMNLP 2025
LangCompress: Language-Aware Compression of Large Language Models AACL 2025
SiLQ: Simple Large Language Model Quantization-Aware Training IJCNLP 2025
SSVQ: Unleashing the Potential of Vector Quantization with Sign-Splitting ICCV 2025
OAC: Output-adaptive Calibration for Accurate Post-training Quantization AAAI 2025
TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models EMNLP 2024
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024
QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024
AFPQ: Asymmetric Floating Point Quantization for LLMs ACL 2024
BitsFusion: 1.99 bits Weight Quantization of Diffusion Model NIPS 2024
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024
One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training AAAI 2024
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge AAAI 2024
Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation AAAI 2024
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024
Delta-CoMe: Training-Free Delta-Compression with Mixed-Precision for Large Language Models NIPS 2024
OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models AAAI 2024
Compensate Quantization Errors: Make Weights Hierarchical to Compensate Each Other NAACL 2024
BitDelta: Your Fine-Tune May Only Be Worth One Bit NIPS 2024
Compressing Large Language Models using Low Rank and Low Precision Decomposition NIPS 2024
On the Way to Lossless Compression of Language Transformers: Exploring Cross-Domain Properties of Quantization COLING 2024