evaluation benchmark

Findings of the SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages EACL 2024 Findings of the WMT 2024 Biomedical Translation Shared Task: Test Sets on Abstract Level EMNLP 2024 FREB-TQA: A Fine-Grained Robustness Evaluation Benchmark for Table Question Answering NAACL 2024 From LLMs to MLLMs: Exploring the Landscape of Multimodal Jailbreaking EMNLP 2024 GameTraversalBenchmark: Evaluating Planning Abilities Of Large Language Models Through Traversing 2D Game Maps NeurIPS 2024 GTBench: Uncovering the Strategic Reasoning Capabilities of LLMs via Game-Theoretic Evaluations NeurIPS 2024 Holistic Evaluation for Interleaved Text-and-Image Generation EMNLP 2024 I2EBench: A Comprehensive Benchmark for Instruction-based Image Editing NeurIPS 2024 IDGen: Item Discrimination Induced Prompt Generation for LLM Evaluation NeurIPS 2024 Investigating Data Contamination in Modern Benchmarks for Large Language Models NAACL 2024 Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models? EMNLP 2024 KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models ACL 2024 Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) NeurIPS 2024 LatEval: An Interactive LLMs Evaluation Benchmark with Incomplete Information from Lateral Thinking Puzzles COLING 2024 Latxa: An Open Language Model and Evaluation Suite for Basque ACL 2024 LawBench: Benchmarking Legal Knowledge of Large Language Models EMNLP 2024 Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs EACL 2024 L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024 LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NeurIPS 2024 M3SciQA: A Multi-Modal Multi-Document Scientific QA Benchmark for Evaluating Foundation Models EMNLP 2024 Machine Translation Evaluation Benchmark for Wu Chinese: Workflow and Analysis EMNLP 2024 Measuring the Robustness of NLP Models to Domain Shifts EMNLP 2024 MiTTenS: A Dataset for Evaluating Gender Mistranslation EMNLP 2024 Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents ACL 2024 MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models EMNLP 2024