Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Q-realign: Piggybacking Realignment on Quantization for Safe and Efficient LLM Deployment

AbstractPublic large language models (LLMs) are typically safety-aligned during pretraining, but task-specific fine-tuning often erodes this alignment, introducing significant safety risks. Existing defenses are largely coupled with the fine-tuning process, incurring high computational overhead and complex workflows. To address these challenges, we propose Q-realign, a post-hoc defense based on quantization. Departing from the conventional view of quantization as a safety-eroding compromise, we reframe it as a dual-purpose mechanism for both compression and safety recovery. This allows Q-realign to decouple safety alignment from fine-tuning and naturally piggyback onto modern deployment pipelines. Experiments across multiple models and datasets demonstrate that our method substantially reduces unsafe behaviors while preserving task performance, significantly improving memory and GPU efficiency. Notably, our approach can recover the safety alignment of a fine-tuned 7B LLM on a single RTX 4090 within 40 minutes. Overall, our work provides a practical, turnkey solution for safety-aware deployment. Our code is released at https://anonymous.4open.science/r/Q-realign-copy-0D71.

More from EMNLP 2026

All EMNLP 2026 papers →