Skip to content
conftrace_

multilingual benchmark

76 papers

Papers

ACID Test: A Benchmark for Cultural Safety and Alignment in LALMs AAAI 2026 AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages ACL 2026 APARSIN: A Multi-Variety Sentiment and Translation Benchmark for Iranic Languages EACL 2026 Can AI-Generated Persuasion Be Detected? Persuaficial Benchmark and AI vs. Human Linguistic Differences ACL 2026 ChiKhaPo: A Large-Scale Multilingual Benchmark for Evaluating Lexical Comprehension and Generation in Large Language Models ACL 2026 CoQuIR: A Comprehensive Benchmark for Code Quality-Aware Information Retrieval ACL 2026 DetectRL-X: Towards Reliable Multilingual and Real-World LLM-Generated Text Detection ACL 2026 Macaron: Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-Filling ACL 2026 MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning EACL 2026 MMSciCode: Real-world Evaluation of Multilingual Multi-Discipline Scientific Research Coding ACL 2026 MMTIT-Bench: A Multilingual and Multi-Scenario Benchmark with Cognition-Perception-Reasoning Guided Text-Image Machine Translation CVPR 2026 MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generation ACL 2026 POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering ACL 2026 RepoGenesis: Benchmarking End-to-End Microservice Generation from Readme to Repository ACL 2026 SEA-Vision: A Multilingual Benchmark for Comprehensive Document and Scene Text Understanding in Southeast Asia CVPR 2026 The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models ACL 2026 BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Models EMNLP 2025 Beyond Human Labels: A Multi-Linguistic Auto-Generated Benchmark for Evaluating Large Language Models on Resume Parsing EMNLP 2025 Can LLMs Truly Plan? A Comprehensive Evaluation of Planning Capabilities EMNLP 2025 CRAB: A Benchmark for Evaluating Curation of Retrieval-Augmented LLMs in Biomedicine EMNLP 2025 CRUXEVAL-X: A Benchmark for Multilingual Code Reasoning, Understanding and Execution ACL 2025 CultureSynth: A Hierarchical Taxonomy-Guided and Retrieval-Augmented Framework for Cultural Question-Answer Synthesis EMNLP 2025 DRISHTIKON: A Multimodal Multilingual Benchmark for Testing Language Models’ Understanding on Indian Culture EMNLP 2025 EXECUTE: A Multilingual Benchmark for LLM Token Understanding ACL 2025 Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation EMNLP 2025