benchmark evaluation

MR-Ben: A Meta-Reasoning Benchmark for Evaluating System-2 Thinking in LLMs NeurIPS 2024 MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models EMNLP 2024 MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Music IJCAI 2024 Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA ACL 2024 MuLan: A Study of Fact Mutability in Language Models NAACL 2024 Multilingual Fact-Checking using LLMs EMNLP 2024 Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Models EMNLP 2024 Multi-Object Hallucination in Vision Language Models NeurIPS 2024 Multi-Task Inference: Can Large Language Models Follow Multiple Instructions at Once? ACL 2024 MultiTrust: A Comprehensive Benchmark Towards Trustworthy Multimodal Large Language Models NeurIPS 2024 MVBench: A Comprehensive Multi-modal Video Understanding Benchmark CVPR 2024 MVP-Bench: Can Large Vision-Language Models Conduct Multi-level Visual Perception Like Humans? EMNLP 2024 MVP: Minimal Viable Phrase for Long Text Understanding COLING 2024 NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samples NeurIPS 2024 NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User Queries ACL 2024 Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NeurIPS 2024 Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs) COLING 2024 Needle In A Multimodal Haystack NeurIPS 2024 Negative Object Presence Evaluation (NOPE) to Measure Object Hallucination in Vision-Language Models ACL 2024 NLEBench+NorGLM: A Comprehensive Empirical Analysis and Benchmark Dataset for Generative Language Models in Norwegian EMNLP 2024 Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models ACL 2024 NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes ACL 2024 NYU CTF Bench: A Scalable Open-Source Benchmark Dataset for Evaluating LLMs in Offensive Security NeurIPS 2024 ODRL: A Benchmark for Off-Dynamics Reinforcement Learning NeurIPS 2024 OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems ACL 2024