Skip to content
conftrace_
2026 EMNLP EMNLP 2026

PR-LoRA: Direction-Regularized Low-Rank Adaptation for Behavioral Alignment in Large Language Models

AbstractBehavioral problems in deployed LLMs are often discovered when only limited supervision is available and repeating full alignment training is impractical. Existing post-hoc methods have complementary limitations: activation steering lacks input adaptivity, while standard LoRA learns without an explicit behavioral direction prior and can be unstable in low-data settings. We introduce PR-LoRA, a direction-regularized LoRA variant that initializes LoRA B matrices with per-layer contrastive behavioral directions and anchors them with an L2 penalty, while leaving A freely trainable. We evaluate PR-LoRA on seven CAA behaviors across Qwen3 and LLaMA models against activation steering and parameter-efficient adaptation baselines. On Qwen3-8B, PR-LoRA lowers the seven-behavior macro-average undesirable-behavior score from .405 to .374 relative to standard LoRA, a 7.8% relative reduction, and outperforms DPO-LoRA and LoReFT under the tested low-update budget.

More from EMNLP 2026

All EMNLP 2026 papers →