benchmark evaluation

Marathon: A Race Through the Realm of Long Context with Large Language Models ACL 2024 MARPLE: A Benchmark for Long-Horizon Inference NeurIPS 2024 MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark ACL 2024 MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts ICLR 2024 Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset NeurIPS 2024 MedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models AAAI 2024 MedCalc-Bench: Evaluating Large Language Models for Medical Calculations NeurIPS 2024 MedExQA: Medical Question Answering Benchmark with Multiple Explanations ACL 2024 MedJourney: Benchmark and Evaluation of Large Language Models over Patient Clinical Journey NeurIPS 2024 MedSafetyBench: Evaluating and Improving the Medical Safety of Large Language Models NeurIPS 2024 Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image Sequences ACL 2024 Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMs NeurIPS 2024 MERA: A Comprehensive LLM Evaluation in Russian ACL 2024 MIBench: Evaluating Multimodal Large Language Models over Multiple Images EMNLP 2024 Micro-Bench: A Microscopy Benchmark for Vision-Language Understanding NeurIPS 2024 MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback ICLR 2024 MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixtures NeurIPS 2024 MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs NeurIPS 2024 MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding NeurIPS 2024 MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems EMNLP 2024 MM-LLMs: Recent Advances in MultiModal Large Language Models ACL 2024 MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark NeurIPS 2024 MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI CVPR 2024 MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception ACL 2024 MoZIP: A Multilingual Benchmark to Evaluate Large Language Models in Intellectual Property COLING 2024