model quantization

279 papers

Explore in graph

Also known as

PTQ INT8 QDNN

Co-occurring keywords

model compression (3283) large language model (12755) knowledge distillation (3680) weight quantization (133) post-training quantization (124) neural network optimization (1293) efficient computing (779) neural network (6616) activation quantization (47) efficient inference (225)

Papers

Interpreting the Effects of Quantization on LLMs IJCNLP 2025

CSPLADE: Learned Sparse Retrieval with Causal Language Models IJCNLP 2025

Slender-Mamba: Fully Quantized Mamba in 1.58 Bits From Head to Toe COLING 2025

ABQ-LLM: Arbitrary-Bit Quantized Inference Acceleration for Large Language Models AAAI 2025

LMU at PerAnsSumm 2025: LlaMA-in-the-loop at Perspective-Aware Healthcare Answer Summarization Task 2.2 Factuality NAACL 2025

DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing WACV 2025

Enhancing Model Privacy in Federated Learning with Random Masking and Quantization EMNLP 2025

Efficient On-Device Text Simplification for Firefox with Synthetic Data Fine-Tuning EMNLP 2025

KurTail : Kurtosis-based LLM Quantization EMNLP 2025

DecDEC: A Systems Approach to Advancing Low-Bit LLM Quantization OSDI 2025

APHQ-ViT: Post-Training Quantization with Average Perturbation Hessian Based Reconstruction for Vision Transformers CVPR 2025

Enhancing AI-Driven Farming Advisory in Kenya with Efficient RAG Agents via Quantized Fine-Tuned Language Models ACL 2025

Data-Free Group-Wise Fully Quantized Winograd Convolution via Learnable Scales CVPR 2025

TinySAM: Pushing the Envelope for Efficient Segment Anything Model AAAI 2025

QuZO: Quantized Zeroth-Order Fine-Tuning for Large Language Models EMNLP 2025

LLMs on a Budget? Say HOLA EMNLP 2025

Understanding Flatness in Generative Models: Its Role and Benefits ICCV 2025

Quantized Can Still Be Calibrated: A Unified Framework to Calibration in Quantized Large Language Models ACL 2025

Does quantization affect models’ performance on long-context tasks? EMNLP 2025

Quantized but Deceptive? A Multi-Dimensional Truthfulness Evaluation of Quantized LLMs EMNLP 2025

Split Adaptation for Pre-trained Vision Transformers CVPR 2025

Variable Layerwise Quantization: A Simple and Effective Approach to Quantize LLMs ACL 2025

QSpec: Speculative Decoding with Complementary Quantization Schemes EMNLP 2025

Treasures in Discarded Weights for LLM Quantization AAAI 2025

QuantCache: Adaptive Importance-Guided Quantization with Hierarchical Latent and Layer Caching for Video Generation ICCV 2025