Skip to content
conftrace_
2026 EMNLP EMNLP 2026

LangKG at the FinEval 2026: Answer-Contract Knowledge over Instruction Engineering

AbstractAutomated multilingual financial question answering requires models to synthesize evidence across SEC filing statements and parallel news reporting in five languages, grounding every claim in aligned, verifiable source material. We participate in the FinNLP 2026 Shared Task (FinEval 2026) Subtask 3, built on the challenging MultiFinBen/PolyFiQA benchmark, under a strict 70-billion-parameter constraint and a Macro-averaged ROUGE-1 F1 evaluation metric. We find that shared task’s practice (train) and test splits encode an inverted query-answer contract, and highly specific prompt engineering tuned against one split overfits and fails to transfer to the other. Motivated by this, we introduce an explicit answer-contract knowledge policy encoding evidence-boundedness, multilingual evidence alignment, exact-value preservation, reporting-period disambiguation, and intentional non-response, and implement it through two complementary generation strategies: Chain-of-Verification (CoVe) and Prompt-variant ensembling with heuristic re-ranking. Our submitted system (ensembling) improves over direct-prompting baseline and CoVe (0.41 to 0.49 ROUGE-1 F1 over train set) and achieves 0.324 ROUGE-1 F1 on the shared task’s leaderboard, ranking 11 of 15 teams.

More from EMNLP 2026

All EMNLP 2026 papers →