multilingual evaluation

Counting the Bugs in ChatGPT’s Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language Model EMNLP 2023 C-XNLI: Croatian Extension of XNLI Dataset ACL 2023 Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features ACL 2023 MEGA: Multilingual Evaluation of Generative AI EMNLP 2023 On Evaluating and Mitigating Gender Biases in Multilingual Settings ACL 2023 Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models EMNLP 2023 Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses EMNLP 2023 TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties EMNLP 2023 TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023 Average Is Not Enough: Caveats of Multilingual Evaluation EMNLP 2022 BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation ACL 2022 Beyond Static models and test sets: Benchmarking the potential of pre-trained models across tasks and languages ACL 2022 Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset EMNLP 2022 Multilingual CheckList: Generation and Evaluation AACL 2022 Multilingual Multimodal Learning with Machine Translated Text EMNLP 2022 AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examples EMNLP 2021 Benchmarking: Past, Present and Future ACL 2021 Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer EMNLP 2021 Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information ACL 2020 Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task EMNLP 2020 TMUOU Submission for WMT20 Quality Estimation Shared Task EMNLP 2020 Sequence Tagging with Contextual and Non-Contextual Subword Representations: A Multilingual Evaluation ACL 2019 Multimodal Frame Identification with Multilingual Evaluation NAACL 2018 One "Ruler" for All Languages: Multi-Lingual Dialogue Evaluation with Adversarial Multi-Task Learning IJCAI 2018