Learning from Dialogue Traces: Retrieval-Guided Tool Use and Response Generation for Task-Oriented Dialogue Agents
Abstract
AbstractEffective task-oriented dialogue (TOD) requires agents to coordinate two tightly coupled decisions of when to invoke external tools and how to formulate a response that satisfies the user’s goal. However, their turn-level behavior remains weakly grounded under fixed zero-shot prompts. Meanwhile, existing retrieval-based TOD agents primarily retrieve task-relevant content from external knowledge sources, guiding which information to include but offering limited guidance on how to select tools and formulate responses in similar dialogue contexts. To mitigate this, we introduce TRACE, a Turn-level Retrieval Agent with Contextual Experiences for TOD [<https://github.com/aistairc/TRACE-TOD>]. Instead of relying on retrieved factual records alone, TRACE retrieves goal-conditioned dialogue snippets as behavioral demonstrations at each turn. These snippets capture similar user goals, constraints, tool-use decisions, and response patterns to guide both tool calls and response generation. Experiments on MultiWOZ 2.1 and Schema-Guided Dialogue (SGD) show that TRACE improves Inform and Success over a competitive LLM agent and end-to-end fine-tuned models under both simulation-based and static-user evaluations. Human evaluation and retrieval-focused analyses further show that goal-conditioned snippets and retrieval quality drive these gains.