benchmark evaluation

MLDebugging: Towards Benchmarking Code Debugging Across Multi-Library Scenarios ACL 2025 MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering ICLR 2025 MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria NAACL 2025 M-LongDoc: A Benchmark For Multimodal Super-Long Document Understanding And A Retrieval-Aware Tuning Framework EMNLP 2025 MLVU: Benchmarking Multi-task Long Video Understanding CVPR 2025 MMAU: A Holistic Benchmark of Agent Capabilities Across Diverse Domains NAACL 2025 MMCR: Benchmarking Cross-Source Reasoning in Scientific Papers ICCV 2025 MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique EMNLP 2025 MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans? ICLR 2025 MMInA: Benchmarking Multihop Multimodal Internet Agents ACL 2025 MMJ-Bench: A Comprehensive Study on Jailbreak Attacks and Defenses for Vision Language Models AAAI 2025 MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation EMNLP 2025 MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark ACL 2025 MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation ACL 2025 MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models ACL 2025 MMVU: Measuring Expert-Level Multi-Discipline Video Understanding CVPR 2025 MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos ICLR 2025 MolErr2Fix: Benchmarking LLM Trustworthiness in Chemistry via Modular Error Detection, Localization, Explanation, and Correction EMNLP 2025 Morables: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables EMNLP 2025 More Than a Score: Probing the Impact of Prompt Specificity on LLM Code Generation IJCNLP 2025 Mosaic of Modalities: A Comprehensive Benchmark for Multimodal Graph Learning CVPR 2025 MotiveBench: How Far Are We From Human-Like Motivational Reasoning in Large Language Models? ACL 2025 MRAG-Bench: Vision-Centric Evaluation for Retrieval-Augmented Multimodal Models ICLR 2025 MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation ICLR 2025 MR. Judge: Multimodal Reasoner as a Judge EMNLP 2025