conftrace_

quantization-aware training

50 papers

Explore in graph

Also known as

QAT

Co-occurring keywords

model compression (3302) large language model (13587) model quantization (281) weight quantization (137) low-bit quantization (39) neural network optimization (1293) knowledge distillation (3725) post-training quantization (131) quantization aware training (9) inference efficiency (248)

Papers

NIPQ: Noise Proxy-Based Integrated Pseudo-Quantization CVPR 2023
Oscillation-free Quantization for Low-bit Vision Transformers ICML 2023
Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers EACL 2023
Overcoming Forgetting Catastrophe in Quantization-Aware Training ICCV 2023
PackQViT: Faster Sub-8-bit Vision Transformers via Full and Packed Quantization on the Mobile NIPS 2023
Lossy Image Compression With Quantized Hierarchical VAEs WACV 2023
QD-BEV : Quantization-aware View-guided Distillation for Multi-view 3D Object Detection ICCV 2023
Zoneformer: On-device Neural Beamformer For In-car Multi-zone Speech Separation, Enhancement and Echo Cancellation INTERSPEECH 2023
Quantization-aware and Tensor-compressed Training of Transformers for Natural Language Understanding INTERSPEECH 2023
Boost Transformer-based Language Models with GPU-Friendly Sparsity and Quantization ACL 2023
PreQuant: A Task-agnostic Quantization Approach for Pre-trained Language Models ACL 2023
On-Device Training Under 256KB Memory NIPS 2022
Optimal Clipping and Magnitude-aware Differentiation for Improved Quantization-aware Training ICML 2022
FP8 Quantization: The Power of the Exponent NIPS 2022
Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders EMNLP 2022
Overcoming Oscillations in Quantization-Aware Training ICML 2022
Sub-8-Bit Quantization Aware Training for 8-Bit Neural Network Accelerator with On-Device Speech Recognition INTERSPEECH 2022
Once Quantization-Aware Training: High Performance Extremely Low-Bit Architecture Search ICCV 2021
FracBits: Mixed Precision Quantization via Fractional Bit-Widths AAAI 2021
Improving Low-Precision Network Quantization via Bin Regularization ICCV 2021
Understanding and Overcoming the Challenges of Efficient Transformer Quantization EMNLP 2021
Quantization Aware Training with Absolute-Cosine Regularization for Automatic Speech Recognition INTERSPEECH 2020
A Statistical Framework for Low-bitwidth Training of Deep Neural Networks NIPS 2020
DFQF: Data Free Quantization-aware Fine-tuning ACML 2020
On-device Structured and Context Partitioned Projection Networks ACL 2019