benchmark evaluation

RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing EMNLP 2025 Rosetta-PL: Propositional Logic as a Benchmark for Large Language Model Reasoning NAACL 2025 RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs EMNLP 2025 RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World Scenarios ACL 2025 RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation NAACL 2025 RusConText Benchmark: A Russian Language Evaluation Benchmark for Understanding Context ACL 2025 SafetyPrompts: A Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety AAAI 2025 SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Information Interspeech 2025 SANSKRITI: A Comprehensive Benchmark for Evaluating Language Models’ Knowledge of Indian Culture ACL 2025 SATBench: Benchmarking LLMs’ Logical Reasoning via Automated Puzzle Generation from SAT Formulas EMNLP 2025 Saudi-Alignment Benchmark: Assessing LLMs Alignment with Cultural Norms and Domain Knowledge in the Saudi Context EMNLP 2025 ScholarBench: A Bilingual Benchmark for Abstraction, Comprehension, and Reasoning Evaluation in Academic Contexts EMNLP 2025 SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis NAACL 2025 ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery ICLR 2025 SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning Types ACL 2025 SciVer: Evaluating Foundation Models for Multimodal Scientific Claim Verification ACL 2025 ScratchEval: Are GPT-4o Smarter than My Child? Evaluating Large Multimodal Models with Visual Programming Challenges NAACL 2025 SECQUE: A Benchmark for Evaluating Real-World Financial Analysis Capabilities ACL 2025 SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science ACL 2025 See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models ACL 2025 seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs EMNLP 2025 Sequential-NIAH: A Needle-In-A-Haystack Benchmark for Extracting Sequential Needles from Long Contexts EMNLP 2025 Side Effects of Erasing Concepts from Diffusion Models EMNLP 2025 SimBA: Simplifying Benchmark Analysis Using Performance Matrices Alone EMNLP 2025 SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants? EMNLP 2025