Evaluation

Riemannian-Geometric Fingerprints of Generative Models ICCV 2025 RoCS-MT v2 at WMT 2025: Robust Challenge Set for Machine Translation EMNLP 2025 RoDEval: A Robust Word Sense Disambiguation Evaluation Framework for Large Language Models EMNLP 2025 Rubrik’s Cube: Testing a New Rubric for Evaluating Explanations on the CUBE dataset ACL 2025 RuleArena: A Benchmark for Rule-Guided Reasoning with LLMs in Real-World Scenarios ACL 2025 SAGE: A Generic Framework for LLM Safety Evaluation EMNLP 2025 Sample-Efficient Human Evaluation of Large Language Models via Maximum Discrepancy Competition ACL 2025 SATBench: Benchmarking LLMs’ Logical Reasoning via Automated Puzzle Generation from SAT Formulas EMNLP 2025 Scalable and Culturally Specific Stereotype Dataset Construction via Human-LLM Collaboration EMNLP 2025 SciEvent: Benchmarking Multi-domain Scientific Event Extraction EMNLP 2025 SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning Types ACL 2025 SeaExam and SeaBench: Benchmarking LLMs with Local Multilingual Questions in Southeast Asia NAACL 2025 SEA-HELM: Southeast Asian Holistic Evaluation of Language Models ACL 2025 SECQUE: A Benchmark for Evaluating Real-World Financial Analysis Capabilities ACL 2025 SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Science ACL 2025 See the World, Discover Knowledge: A Chinese Factuality Evaluation for Large Vision Language Models ACL 2025 SEEval: Advancing LLM Text Evaluation Efficiency and Accuracy through Self-Explanation Prompting NAACL 2025 Semantic-Eval : A Semantic Comprehension Evaluation Framework for Large Language Models Generation without Training ACL 2025 Semantic Masking in a Needle-in-a-haystack Test for Evaluating Large Language Model Long-Text Capabilities COLING 2025 Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level Aggregation AAAI 2025 SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection ACL 2025 seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs EMNLP 2025 Shared Path: Unraveling Memorization in Multilingual LLMs through Language Similarities EMNLP 2025 SHARP: Unlocking Interactive Hallucination via Stance Transfer in Role-Playing LLMs ACL 2025 Should I Share this Translation? Evaluating Quality Feedback for User Reliance on Machine Translation EMNLP 2025