large language model evaluation

Beyond Value Benchmarks: Measuring Value-Structure Alignment in Large Language Models via Symmetric Q-Sorts ACL 2026 ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models ACL 2026 KG-MuLQA: A Framework for KG-based Multi-Level QA Extraction and Long-Context LLM Evaluation ACL 2026 Cracking the Code: Multi-domain LLM Evaluation on Real-World Professional Exams in Indonesia NAACL 2025 DnA-Eval: Enhancing Large Language Model Evaluation through Decomposition and Aggregation COLING 2025 IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025 Instance-level Randomization: Toward More Stable LLM Evaluations EMNLP 2025 Persona-Augmented Benchmarking: Evaluating LLMs Across Diverse Writing Styles EMNLP 2025 PricingLogic: Evaluating LLMs Reasoning on Complex Tourism Pricing Tasks EMNLP 2025 StructFlowBench: A Structured Flow Benchmark for Multi-turn Instruction Following ACL 2025 Transparent Reference-free Automated Evaluation of Open-Ended User Survey Responses EMNLP 2025 Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphs ACL 2024 Evalverse: Unified and Accessible Library for Large Language Model Evaluation EMNLP 2024 FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024 Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation EMNLP 2024 LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NeurIPS 2024 Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation ACL 2024 MCTS: A Multi-Reference Chinese Text Simplification Dataset COLING 2024 Revisiting the Self-Consistency Challenges in Multi-Choice Question Formats for Large Language Model Evaluation COLING 2024 Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction ACL 2023