evaluation benchmark

Will Multimodal Models Be Dazzled by Multi-Image Visual Puzzles? CVPR 2026 WorldLens: Full-Spectrum Evaluations of Driving World Models in Real World CVPR 2026 100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability? ACL 2025 Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models ACL 2025 AIR-Bench: Automated Heterogeneous Information Retrieval Benchmark ACL 2025 A Japanese Language Model and Three New Evaluation Benchmarks for Pharmaceutical NLP IJCNLP 2025 An Empirical Study of Position Bias in Modern Information Retrieval EMNLP 2025 AraTrust: An Evaluation of Trustworthiness for LLMs in Arabic COLING 2025 A Survey of Multilingual Reasoning in Language Models EMNLP 2025 Beyond Facts: Evaluating Intent Hallucination in Large Language Models ACL 2025 Beyond Single-Value Metrics: Evaluating and Enhancing LLM Unlearning with Cognitive Diagnosis ACL 2025 Beyond Surface Simplicity: Revealing Hidden Reasoning Attributes for Precise Commonsense Diagnosis ACL 2025 BIG-Bench Extra Hard ACL 2025 CE-Bench: Towards a Reliable Contrastive Evaluation Benchmark of Interpretability of Sparse Autoencoders EMNLP 2025 Century: A Framework and Dataset for Evaluating Historical Contextualisation of Sensitive Images ICLR 2025 CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Models NAACL 2025 CIVET: Systematic Evaluation of Understanding in VLMs EMNLP 2025 CMT-Eval: A Novel Chinese Multi-turn Dialogue Evaluation Dataset Addressing Real-world Conversational Challenges EMNLP 2025 Collab-Overcooked: Benchmarking and Evaluating Large Language Models as Collaborative Agents EMNLP 2025 CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward EMNLP 2025 ConCodeEval: Evaluating Large Language Models for Code Constraints in Domain-Specific Languages ACL 2025 CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025 Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia NAACL 2025 CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments NAACL 2025 Culture is Everywhere: A Call for Intentionally Cultural Evaluation EMNLP 2025