Evaluation

o-MEGA: Optimized Methods for Explanation Generation and Analysis EMNLP 2025 OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domain EMNLP 2025 On A Scale From 1 to 5: Quantifying Hallucination in Faithfulness Evaluation NAACL 2025 On Crowdsourcing Task Design for Discourse Relation Annotation COLING 2025 On LLM-Based Scientific Inductive Reasoning Beyond Equations EMNLP 2025 Only a Little to the Left: A Theory-grounded Measure of Political Bias in Large Language Models ACL 2025 On Many-Shot In-Context Learning for Long-Context Evaluation ACL 2025 Open Ko-LLM Leaderboard2: Bridging Foundational and Practical Evaluation for Korean LLMs NAACL 2025 Optimization before Evaluation: Evaluation with Unoptimized Prompts Can be Misleading ACL 2025 Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults EMNLP 2025 OWL: Probing Cross-Lingual Recall of Memorized Texts via World Literature EMNLP 2025 PapersPlease: A Benchmark for Evaluating Motivational Values of Large Language Models Based on ERG Theory ACL 2025 Parametric ρ-Norm Scaling Calibration AAAI 2025 PATCH! Psychometrics-AssisTed BenCHmarking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics ACL 2025 PatentScore: Multi-dimensional Evaluation of LLM-Generated Patent Claims EMNLP 2025 Pathway to Relevance: How Cross-Encoders Implement a Semantic Variant of BM25 EMNLP 2025 Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine ACL 2025 PCRI: Measuring Context Robustness in Multimodal Models for Enterprise Applications EMNLP 2025 Persona-Augmented Benchmarking: Evaluating LLMs Across Diverse Writing Styles EMNLP 2025 Personality Matters: User Traits Predict LLM Preferences in Multi-Turn Collaborative Tasks EMNLP 2025 PhysReason: A Comprehensive Benchmark towards Physics-Based Reasoning ACL 2025 P-MMEval: A Parallel Multilingual Multitask Benchmark for Consistent Evaluation of LLMs EMNLP 2025 PoSum-Bench: Benchmarking Position Bias in LLM-based Conversational Summarization EMNLP 2025 Practical Solutions to Practical Problems in Developing Argument Mining Systems ACL 2025 Predicting Fine-tuned Performance on Larger Datasets Before Creating Them COLING 2025