llm evaluation

Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases EMNLP 2025 MedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses EMNLP 2025 Metric assessment protocol in the context of answer fluctuation on MCQ tasks ACL 2025 Mind the Value-Action Gap: Do LLMs Act in Alignment with Their Values? EMNLP 2025 MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems NAACL 2025 Model Consistency as a Cheap yet Predictive Proxy for LLM Elo Scores EMNLP 2025 Nuance Matters: Probing Epistemic Consistency in Causal Reasoning AAAI 2025 ObjVariantEnsemble: Advancing Point Cloud LLM Evaluation in Challenging Scenes with Subtly Distinguished Objects AAAI 2025 OpenHuEval: Evaluating Large Language Model on Hungarian Specifics ACL 2025 Optimization before Evaluation: Evaluation with Unoptimized Prompts Can be Misleading ACL 2025 PlanningArena: A Modular Benchmark for Multidimensional Evaluation of Planning and Tool Learning ACL 2025 Praetor: A Fine-Grained Generative LLM Evaluator with Instance-Level Customizable Evaluation Criteria ACL 2025 PromptSuite: A Task-Agnostic Framework for Multi-Prompt Generation EMNLP 2025 Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat ACL 2025 REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025 Research Borderlands: Analysing Writing Across Research Cultures ACL 2025 Scalable and Culturally Specific Stereotype Dataset Construction via Human-LLM Collaboration EMNLP 2025 SimulatorArena: Are User Simulators Reliable Proxies for Multi-Turn Evaluation of AI Assistants? EMNLP 2025 so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs EMNLP 2025 The Progress Illusion: Revisiting meta-evaluation standards of LLM evaluators EMNLP 2025 The Staircase of Ethics: Probing LLM Value Priorities through Multi-Step Induction to Complex Moral Dilemmas EMNLP 2025 TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025 TN-Eval: Rubric and Evaluation Protocols for Measuring the Quality of Behavioral Therapy Notes ACL 2025 Towards Optimal Evaluation Efficiency for Large Language Models EMNLP 2025 Transparent Reference-free Automated Evaluation of Open-Ended User Survey Responses EMNLP 2025