evaluation framework

Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluation NAACL 2025 SPHERE: An Evaluation Card for Human-AI Systems ACL 2025 Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation ACL 2025 Stop Playing the Guessing Game! Evaluating Conversational Recommender Systems via Target-free User Simulation EMNLP 2025 Synthetic Data for Evaluation: Supporting LLM-as-a-Judge Workflows with EvalAssist EMNLP 2025 SynthTextEval: Synthetic Text Data Generation and Evaluation for High-Stakes Domains EMNLP 2025 Tau-Eval: A Unified Evaluation Framework for Useful and Private Text Anonymization EMNLP 2025 The Geometry of Queries: Query-Based Innovations in Retrieval-Augmented Generation for Healthcare QA MLHC 2025 The Reader is the Metric: How Textual Features and Reader Profiles Explain Conflicting Evaluations of AI Creative Writing ACL 2025 Think Like a Person Before Responding: A Multi-Faceted Evaluation of Persona-Guided LLMs for Countering Hate Speech. ACL 2025 TN-Eval: Rubric and Evaluation Protocols for Measuring the Quality of Behavioral Therapy Notes ACL 2025 Toward Human-Centered Readability Evaluation EMNLP 2025 Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage ICML 2025 Towards a Holistic and Automated Evaluation Framework for Multi-Level Comprehension of LLMs in Book-Length Contexts EMNLP 2025 Towards A “Novel” Benchmark: Evaluating Literary Fiction with Large Language Models ACL 2025 Towards Better Open-Ended Text Generation: A Multicriteria Evaluation Framework ACL 2025 Unanswerability Evaluation for Retrieval Augmented Generation ACL 2025 UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation CVPR 2025 What Would You Ask When You First Saw a2+b2=c2? Evaluating LLM on Curiosity-Driven Question Generation IJCNLP 2025 ZeroSumEval: An Extensible Framework For Scaling LLM Evaluation with Inter-Model Competition ACL 2025 A Comprehensive View of Personalized Federated Learning on Heterogeneous Clinical Datasets MLHC 2024 An Evaluation Mechanism of LLM-based Agents on Manipulating APIs EMNLP 2024 Automated Assessment of Fidelity and Interpretability: An Evaluation Framework for Large Language Models’ Explanations (Student Abstract) AAAI 2024 ConSiDERS-The-Human Evaluation Framework: Rethinking Human Evaluation for Generative Large Language Models ACL 2024 Evalverse: Unified and Accessible Library for Large Language Model Evaluation EMNLP 2024