Skip to content
conftrace_
2026 EMNLP EMNLP 2026

GAC: Noise-Aware Adaptive Mixing for Hybrid SFT-RL Post-Training

AbstractHybrid post-training combining supervised fine-tuning (SFT) and reinforcement learning (RL) is the standard paradigm for aligning large language models, yet fixed mixing schedules cannot adapt when the relative noise of the two signals evolves. We derive a noise-aware mixing weight by minimizing an MSE upper bound on the mixed stochastic gradient, yielding a closed-form that balances gradient noise variance and SFT–RL disagreement. Building on the token-wise reweighting of CHORD (CITATION)

🌉 Interdisciplinary Bridge - Artificial Intelligence and Reinforcement Learning

More from EMNLP 2026

All EMNLP 2026 papers →