Evaluation

Efficient LLM Comparative Assessment: A Product of Experts Framework for Pairwise Comparisons EMNLP 2024 Efficient multi-prompt evaluation of LLMs NeurIPS 2024 Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards EMNLP 2024 EmoBench: Evaluating the Emotional Intelligence of Large Language Models ACL 2024 ERBench: An Entity-Relationship based Automatically Verifiable Hallucination Benchmark for Large Language Models NeurIPS 2024 ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models EMNLP 2024 Estimating Agreement by Chance for Sequence Annotation ACL 2024 Evaluating Automatic Metrics with Incremental Machine Translation Systems EMNLP 2024 Evaluating Large Language Models via Linguistic Profiling EMNLP 2024 Evaluating LLMs for Targeted Concept Simplification for Domain-Specific Texts EMNLP 2024 Evaluating n-Gram Novelty of Language Models Using Rusty-DAWG EMNLP 2024 Evaluating Psychological Safety of Large Language Models EMNLP 2024 Evaluating the Effectiveness of Large Language Models in Establishing Conversational Grounding EMNLP 2024 Every Answer Matters: Evaluating Commonsense with Probabilistic Measures ACL 2024 EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations NeurIPS 2024 Examining the robustness of LLM evaluation to the distributional assumptions of benchmarks ACL 2024 EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models ACL 2024 Expanding the FLORES+ Multilingual Benchmark with Translations for Aragonese, Aranese, Asturian, and Valencian EMNLP 2024 Extrinsic Evaluation of Cultural Competence in Large Language Models EMNLP 2024 Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers EMNLP 2024 Failures and Successes of Cross-Validation for Early-Stopped Gradient Descent AISTATS 2024 Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments EMNLP 2024 F-Eval: Asssessing Fundamental Abilities with Refined Evaluation Methods ACL 2024 Findings of the SIGTYP 2024 Shared Task on Word Embedding Evaluation for Ancient and Historical Languages EACL 2024 Fine-Grained Detection of Solidarity for Women and Migrants in 155 Years of German Parliamentary Debates EMNLP 2024