UCO: A Multi-Turn Interactive Reinforcement Learning Method for Adaptive Teaching with Large Language Models
Abstract
AbstractLarge language models (LLMs) are shifting from answer providers to intelligent tutors in educational settings. However, current supervised fine-tuning methods only learn surface-level teaching patterns without dynamic adaptation. Recent reinforcement learning approaches address this, yet two key challenges remain. First, they evaluate teaching effectiveness solely based on whether students produce correct outputs, unable to distinguish whether students genuinely understand or echo teacher-provided answers. Second, they cannot perceive students’ evolving cognitive states through dialogue, failing to adapt teaching strategies accordingly. We propose Unidirectional Cognitive Optimization (UCO) to address these challenges. UCO employs a multi-turn interactive reinforcement learning paradigm with two synergistic reward functions: the Progress Reward captures cognitive advancement, evaluating students’ transition from confusion to comprehension, and the Scaffold Reward dynamically identifies each student’s Zone of Proximal Development (ZPD), encouraging the teacher to conduct productive teaching within this zone. We evaluate UCO against 11 baseline models on BigMath and MathTutorBench. Results demonstrate that UCO outperforms all equivalent-scale models and achieves performance comparable to leading closed-source models. Code is available at https://github.com/ECNU-RAIL/UCO-EMNLP2026.