benchmark evaluation

MTU-Bench: A Multi-granularity Tool-Use Benchmark for Large Language Models ICLR 2025 MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering ACL 2025 MUG-Eval: A Proxy Evaluation Framework for Multilingual Generation Capabilities in Any Language EMNLP 2025 MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents ACL 2025 MultiChartQA: Benchmarking Vision-Language Models on Multi-Chart Problems NAACL 2025 MultiHoax: A Dataset of Multi-hop False-premise questions ACL 2025 Multi-LMentry: Can Multilingual LLMs Solve Elementary Tasks Across Languages? EMNLP 2025 MULTITAT: Benchmarking Multilingual Table-and-Text Question Answering EMNLP 2025 MultiVerse: A Multi-Turn Conversation Benchmark for Evaluating Large Vision and Language Models ICCV 2025 MULTIVOX: A Benchmark for Evaluating Voice Assistants for Multimodal Interactions EMNLP 2025 MUSTS: MUltilingual Semantic Textual Similarity Benchmark ACL 2025 MV-MATH: Evaluating Multimodal Math Reasoning in Multi-Visual Contexts CVPR 2025 Natural Context Drift Undermines the Natural Language Understanding of Large Language Models EMNLP 2025 NegVQA: Can Vision Language Models Understand Negation? ACL 2025 NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API Calls EMNLP 2025 NesTools: A Dataset for Evaluating Nested Tool Learning Abilities of Large Language Models COLING 2025 None of the Above, Less of the Right Parallel Patterns in Human and LLM Performance on Multi-Choice Questions Answering ACL 2025 NorEval: A Norwegian Language Understanding and Generation Evaluation Benchmark ACL 2025 NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts EMNLP 2025 NovPhy: A Physical Reasoning Benchmark for Open-World AI Systems Author Links Open Overlay Panel (Abstract Reprint) IJCAI 2025 NTSEBENCH: Cognitive Reasoning Benchmark for Vision Language Models NAACL 2025 Number Cookbook: Number Understanding of Language Models and How to Improve It ICLR 2025 Nunchi-Bench: Benchmarking Language Models on Cultural Reasoning with a Focus on Korean Superstition ACL 2025 OAgents: An Empirical Study of Building Effective Agents EMNLP 2025 OBI-Bench: Can LMMs Aid in Study of Ancient Script on Oracle Bones? ICLR 2025