conftrace_

weight quantization

137 papers

Explore in graph

Also known as

WQ

Co-occurring keywords

model compression (3302) model quantization (281) large language model (13587) post-training quantization (131) neural network quantization (122) activation quantization (49) neural network optimization (1293) knowledge distillation (3725) binary neural network (75) inference optimization (219)

Papers

Exploring Quantization for Efficient Pre-Training of Transformer Language Models EMNLP 2024
QBB: Quantization with Binary Bases for LLMs NIPS 2024
MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization NIPS 2024
Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge AAAI 2024
BitDelta: Your Fine-Tune May Only Be Worth One Bit NIPS 2024
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models ACL 2024
QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization EMNLP 2024
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024
SS1: Accelerating Inference with Fast and Expressive Sketch Structured Transform NIPS 2024
DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs NIPS 2024
Mixture of Scales: Memory-Efficient Token-Adaptive Binarization for Large Language Models NIPS 2024
Understanding Int4 Quantization for Language Models: Latency Speedup, Composability, and Failure Cases ICML 2023
ASkewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks AISTATS 2023
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models ICML 2023
Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantisation. NIPS 2023
Oscillation-free Quantization for Low-bit Vision Transformers ICML 2023
Quantized Distributed Training of Large Models with Convergence Guarantees ICML 2023
Jumping through Local Minima: Quantization in the Loss Landscape of Vision Transformers ICCV 2023
Lossy and Lossless (L2) Post-training Model Size Compression ICCV 2023
SparseGPT: Massive Language Models Can be Accurately Pruned in One-Shot ICML 2023
2-bit Conformer quantization for automatic speech recognition INTERSPEECH 2023
Resilient Binary Neural Network AAAI 2023
On Quantizing Implicit Neural Representations WACV 2023
Watermarking LLMs with Weight Quantization EMNLP 2023