Evaluation

Preserve or Modify? Context-Aware Evaluation for Balancing Preservation and Modification in Text-Guided Image Editing CVPR 2025 PreSumm: Predicting Summarization Performance Without Summarizing ACL 2025 Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance EMNLP 2025 PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models ACL 2025 PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation EMNLP 2025 Proportional Representation in Practice: Quantifying Proportionality in Ordinal Elections AAAI 2025 PROTECT: Policy-Related Organizational Value Taxonomy for Ethical Compliance and Trust ACL 2025 Proverbs Run in Pairs: Evaluating Proverb Translation Capability of Large Language Model ACL 2025 ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering ACL 2025 PsyScam: A Benchmark for Psychological Techniques in Real-World Scams EMNLP 2025 QG-SMS: Enhancing Test Item Analysis via Student Modeling and Simulation ACL 2025 QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluation EMNLP 2025 QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions ACL 2025 Quantifying Semantic Emergence in Language Models ACL 2025 Questioning Our Questions: How Well Do Medical QA Benchmarks Evaluate Clinical Capabilities of Language Models? ACL 2025 RAGEval: Scenario Specific RAG Evaluation Dataset Generation Framework ACL 2025 Random Splitting Negatively Impacts NER Evaluation: Quantifying and Eliminating the Overestimation of NER Performance ACL 2025 RankedCOMET: Elevating a 2022 Baseline to a Top-5 Finish in the WMT 2025 QE Task EMNLP 2025 RAP: A Metric for Balancing Repetition and Performance in Open-Source Large Language Models NAACL 2025 RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks EMNLP 2025 RCScore: Quantifying Response Consistency in Large Language Models EMNLP 2025 Readability Reconsidered A Cross-Dataset Analysis of Reference-Free Metrics EMNLP 2025 RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysis ACL 2025 Real-World Summarization: When Evaluation Reaches Its Limits EMNLP 2025 Recurrent Neural Goodness-of-Fit Test for Time Series AISTATS 2025