model quantization

279 papers

Explore in graph

Also known as

PTQ INT8 QDNN

Co-occurring keywords

model compression (3283) large language model (12755) knowledge distillation (3680) weight quantization (133) post-training quantization (124) neural network optimization (1293) efficient computing (779) neural network (6616) activation quantization (47) efficient inference (225)

Papers

DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing WACV 2025

LiteLMGuard: Seamless and Lightweight On-Device Guardrails for Small Language Models against Quantization Vulnerabilities IJCNLP 2025

Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation EMNLP 2025

Vicomtech@WMT 2025: Evolutionary Model Compression for Machine Translation EMNLP 2025

MeMoTune: A Measure and Moment-Driven Fine-Tuning Framework for Quantized Large Language Models ACL 2025

BitNet: 1-bit Pre-training for Large Language Models JMLR 2025

Slender-Mamba: Fully Quantized Mamba in 1.58 Bits From Head to Toe COLING 2025

QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning ICCV 2025

CSPLADE: Learned Sparse Retrieval with Causal Language Models AACL 2025

Understanding Flatness in Generative Models: Its Role and Benefits ICCV 2025

GIFT-SW: Gaussian noise Injected Fine-Tuning of Salient Weights for LLMs ACL 2025

JAQ: Joint Efficient Architecture Design and Low-Bit Quantization with Hardware-Software Co-Exploration AAAI 2025

AMXFP4: Taming Activation Outliers with Asymmetric Microscaling Floating-Point for 4-bit LLM Inference ACL 2025

PTMQ: Post-training Multi-Bit Quantization of Neural Networks AAAI 2024

Fed-QSSL: A Framework for Personalized Federated Learning under Bitwidth and Data Heterogeneity AAAI 2024

xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024

TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models CVPR 2024

BiDM: Pushing the Limit of Quantization for Diffusion Models NIPS 2024

TinyAgent: Function Calling at the Edge EMNLP 2024

Lisbon Computational Linguists at SemEval-2024 Task 2: Using a Mistral-7B Model and Data Augmentation SEMEVAL 2024

Can Large Language Models Understand Context? EACL 2024

DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs NIPS 2024

QUIK: Towards End-to-end 4-Bit Inference on Generative Large Language Models EMNLP 2024

Prefixing Attention Sinks can Mitigate Activation Outliers for Large Language Model Quantization EMNLP 2024

Instance-Aware Group Quantization for Vision Transformers CVPR 2024