conftrace_

diagnostic dataset

10 papers

Explore in graph

Co-occurring keywords · papers mentioning both

visual reasoning (3) visual question answering (3) linguistic perturbation (2) language model (2) natural language understanding (2) natural language inference (2) quantificational reasoning (1) degree semantics (1) adjective scale (1) metric reliability (1)

Papers

Adjective Scale Probe: Can Language Models Encode Formal Semantics Information? AAAI 2023 CTL++: Evaluating Generalization on Never-Seen Compositional Patterns of Known Functions, and Compatibility of Neural Representations EMNLP 2022 DEMETR: Diagnosing Evaluation Metrics for Translation EMNLP 2022 QLEVR: A Diagnostic Dataset for Quantificational Language and Elementary Visual Reasoning NAACL 2022 Testing Pre-trained Language Models’ Understanding of Distributivity via Causal Mediation Analysis EMNLP 2022 Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization EMNLP 2021 DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue ACL 2021 The Sensitivity of Language Models and Humans to Winograd Schema Perturbations ACL 2020 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding EMNLP 2018 CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning CVPR 2017