conftrace_

multilingual evaluation

104 papers

Explore in graph

Co-occurring keywords

large language model (13587) low-resource language (2273) multilingual nlp (1426) benchmark evaluation (1556) machine translation (2499) evaluation benchmark (257) language model (4599) language model evaluation (227) natural language processing (2034) cross-lingual transfer (1477)

Papers

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model ACL 2024
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains ACL 2024
Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models? EMNLP 2024
MEGA: Multilingual Evaluation of Generative AI EMNLP 2023
C-XNLI: Croatian Extension of XNLI Dataset ACL 2023
Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses EMNLP 2023
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features ACL 2023
On Evaluating and Mitigating Gender Biases in Multilingual Settings ACL 2023
TARJAMAT: Evaluation of Bard and ChatGPT on Machine Translation of Ten Arabic Varieties EMNLP 2023
Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic EMNLP 2023
Counting the Bugs in ChatGPT’s Wugs: A Multilingual Investigation into the Morphological Capabilities of a Large Language Model EMNLP 2023
Polyglot or Not? Measuring Multilingual Encyclopedic Knowledge in Foundation Models EMNLP 2023
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models EMNLP 2023
Average Is Not Enough: Caveats of Multilingual Evaluation EMNLP 2022
Beyond Static models and test sets: Benchmarking the potential of pre-trained models across tasks and languages ACL 2022
Multilingual CheckList: Generation and Evaluation AACL 2022
Multilingual Multimodal Learning with Machine Translated Text EMNLP 2022
BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation ACL 2022
Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset EMNLP 2022
AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examples EMNLP 2021
Benchmarking: Past, Present and Future ACL 2021
Benchmarking: Past, Present and Future IJCNLP 2021
Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfer EMNLP 2021
TMUOU Submission for WMT20 Quality Estimation Shared Task EMNLP 2020
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task EMNLP 2020