Skip to content
conftrace_
2026 EMNLP EMNLP 2026

FUSE: Failure-Guided Scenario Synthesis and Weighted Refinement for LLM Function Calling

AbstractLarge language model (LLM) agents increasingly rely on function calling to act across multi-turn interactions, but compact models remain brittle when tool availability, required parameters, and dialogue constraints change over time. Existing synthetic tool-use data often broadens coverage without targeting the recurring failures of a specific model. We present FUSE, a failure-guided refinement approach that uses the model’s own function-calling errors to synthesize harder training scenarios and then emphasizes difficult examples during supervised fine-tuning. This data-centric design turns diagnostic failures into targeted training signal while remaining simple to apply with standard offline fine-tuning. Experiments on BFCLv3 show that FUSE substantially improves a compact Qwen3-based model across standard and stress categories, including missing functions, missing parameters, and long-context interactions. Evaluation on BFCLv4 provides initial evidence that the same refinement strategy can transfer to selected agentic function-calling tasks.

More from EMNLP 2026

All EMNLP 2026 papers →