conftrace_

quantization-aware training

50 papers

Explore in graph

Also known as

QAT

Co-occurring keywords

model compression (3302) large language model (13587) model quantization (281) weight quantization (137) low-bit quantization (39) neural network optimization (1293) knowledge distillation (3725) post-training quantization (131) quantization aware training (9) inference efficiency (248)

Papers

Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs ACL 2026
PE-QAT: Parameter-Efficient Quantization-Aware Training for Large Language Models ACL 2026
Are Large Language Models Economically Viable for Industry Deployment? ACL 2026
Double Rounding: Nearly Lossless Adaptive Bit Switching for QAT AAAI 2026
Saliency-Aware Quantized Imitation Learning for Efficient Robotic Control ICCV 2025
JAQ: Joint Efficient Architecture Design and Low-Bit Quantization with Hardware-Software Co-Exploration AAAI 2025
Continual Quantization-Aware Pre-Training: When to transition from 16-bit to 1.58-bit pre-training for BitNet language models? ACL 2025
Scheduling Weight Transitions for Quantization-Aware Training ICCV 2025
SiLQ: Simple Large Language Model Quantization-Aware Training AACL 2025
Rotate, Clip, and Partition: Towards W2A4KV4 Quantization by Integrating Rotation and Learnable Non-uniform Quantizer EMNLP 2025
Allowing Oscillation Quantization: Overcoming Solution Space Limitation in Low Bit-Width Quantization ICCV 2025
L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models ACL 2025
Outlier-Aware Post-Training Quantization for Image Super-Resolution ICCV 2025
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models ACL 2025
Can Post-Training Quantization Benefit from an Additional QLoRA Integration? NAACL 2025
Scaling Laws and Efficient Inference for Ternary Language Models ACL 2025
SiLQ: Simple Large Language Model Quantization-Aware Training IJCNLP 2025
Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs EMNLP 2024
DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models EMNLP 2024
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation ACL 2024
Self-Supervised Quantization-Aware Knowledge Distillation AISTATS 2024
PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression NIPS 2024
Reducing the Side-Effects of Oscillations in Training of Quantized YOLO Networks WACV 2024
Temporal Dynamic Quantization for Diffusion Models NIPS 2023
Towards Fully Quantized Neural Networks For Speech Enhancement INTERSPEECH 2023