challenge set

GAMBIT+: A Challenge Set for Evaluating Gender Bias in Machine Translation Quality Estimation Metrics EMNLP 2025 RoCS-MT v2 at WMT 2025: Robust Challenge Set for Machine Translation EMNLP 2025 ACES: Translation Accuracy Challenge Sets at WMT 2023 EMNLP 2023 AMR Parsing is Far from Solved: GrAPES, the Granular AMR Parsing Evaluation Suite EMNLP 2023 Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective EMNLP 2023 GENTLE: A Genre-Diverse Multilayer Challenge Set for English NLP and Linguistic Evaluation ACL 2023 Multifaceted Challenge Set for Evaluating Machine Translation Performance EMNLP 2023 RoCS-MT: Robustness Challenge Set for Machine Translation EMNLP 2023 ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics EMNLP 2022 Exploring Robustness of Machine Translation Metrics: A Study of Twenty-Two Automatic Metrics in the WMT22 Metric Task EMNLP 2022 Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set EMNLP 2022 Nibbling at the Hard Core of Word Sense Disambiguation ACL 2022 Extending Challenge Sets to Uncover Gender Bias in Machine Translation: Impact of Stereotypical Verbs and Adjectives EMNLP 2021 gENder-IT: An Annotated English-Italian Parallel Challenge Set for Cross-Linguistic Natural Gender Phenomena ACL 2021 Improving the Robustness of QA Models to Challenge Sets with Variational Question-Answer Pair Generation ACL 2021 NoiseQA: Challenge Set Evaluation for User-Centric Question Answering EACL 2021 Probing Language Models for Understanding of Temporal Expressions EMNLP 2021 Semantics Altering Modifications for Evaluating Comprehension in Machine Reading AAAI 2021 A Challenge Set and Methods for Noun-Verb Ambiguity EMNLP 2018 Trick Me If You Can: Adversarial Writing of Trivia Challenge Questions ACL 2018 A Challenge Set Approach to Evaluating Machine Translation EMNLP 2017