conftrace_

diagnostic evaluation

9 papers

Explore in graph

Co-occurring keywords · papers mentioning both

commonsense reasoning (2) vision-language model (2) benchmark evaluation (2) cross-chart integration (1) video inpainting (1) reconstruction quality (1) large language model (1) transitive reasoning (1) decision-making process (1) failure mode analysis (1)

Papers

AgentDiagnose: An Open Toolkit for Diagnosing LLM Agent Trajectories EMNLP 2025 INTERCHART: Benchmarking Visual Reasoning Across Decomposed and Distributed Chart Information IJCNLP 2025 Reasoning or a Semblance of it? A Diagnostic Study of Transitive Reasoning in LLMs EMNLP 2024 CLEVR-Implicit: A Diagnostic Dataset for Implicit Reasoning in Referring Expression Comprehension EMNLP 2023 The DEVIL Is in the Details: A Diagnostic Evaluation Benchmark for Video Inpainting CVPR 2022 Can Transformer Language Models Predict Psychometric Properties? ACL 2021 TGEA: An Error-Annotated Dataset and Benchmark Tasks for TextGeneration from Pretrained Language Models ACL 2021 Does my multimodal model learn cross-modal interactions? It’s harder to tell than you might think! EMNLP 2020 Getting Closer to AI Complete Question Answering: A Set of Prerequisite Real Tasks AAAI 2020