Skip to content
conftrace_
2026 EMNLP EMNLP 2026

ARIA: Affect-Responsive Interaction Alignment for Emotional Support Policies via Implicit Multimodal Affective Feedback

AbstractEffective emotional-support dialogue requires more than fluent empathy: responses must adapt to the support seeker’s evolving state. Existing emotional-support systems are largely optimized at the response level and may therefore learn the form of supportive counseling without reliably adapting to client-side change. We introduce ARIA, Affect-Responsive Interaction Alignment, a client-centered alignment framework that constructs DPO preference pairs from the support seeker’s subsequent multimodal affective trajectories observed in human interactions. ARIA distills audio- and visual-derived valence trajectories into text-based predictors and uses cross-modal consensus and uncertainty-aware filtering to identify high-confidence preferences associated with delayed client-side valence improvement. Experiments show that ARIA improves process-oriented measures of client progress beyond surface compliance and produces support that is more timely and calibrated to the seeker’s evolving openness. Behavioral analyses further show a phase-sensitive shift from restrained pre-open support toward more active support after openness emerges. Human and counseling-expert evaluations provide evidence that ARIA’s responses are more timely, targeted, and supportive of the client’s own process.

More from EMNLP 2026

All EMNLP 2026 papers →