automatic evaluation

A Comprehensive Analysis of the Effectiveness of Large Language Models as Automatic Dialogue Evaluators AAAI 2024 A Multi-Aspect Framework for Counter Narrative Evaluation using Large Language Models NAACL 2024 ARTS: Assessing Readability & Text Simplicity EMNLP 2024 ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language Models EMNLP 2024 AttributionBench: How Hard is Automatic Attribution Evaluation? ACL 2024 Auto-ACE: An Automatic Answer Correctness Evaluation Method for Conversational Question Answering ACL 2024 Automatic Evaluation of a Sentence Memory Test for Preschool Children Interspeech 2024 Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models COLING 2024 Automatic, Meta and Human Evaluation for Multimodal Summarization with Multimodal Output NAACL 2024 Benchmarking Cognitive Biases in Large Language Models as Evaluators ACL 2024 Benchmarking the Performance of Machine Translation Evaluation Metrics with Chinese Multiword Expressions COLING 2024 Can Automatic Metrics Assess High-Quality Translations? EMNLP 2024 Characterizing the Confidence of Large Language Model-Based Automatic Evaluation Metrics EACL 2024 ConvBench: A Multi-Turn Conversation Evaluation Benchmark with Hierarchical Ablation Capability for Large Vision-Language Models NeurIPS 2024 Digital Socrates: Evaluating LLMs through Explanation Critiques ACL 2024 EASSE-DE & EASSE-multi: Easier Automatic Sentence Simplification Evaluation for German & Multiple Languages EMNLP 2024 EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models CVPR 2024 Error Analysis of Multilingual Language Models in Machine Translation: A Case Study of English-Amharic Translation EMNLP 2024 Evaluating Document Simplification: On the Importance of Separately Assessing Simplicity and Meaning Preservation COLING 2024 Evaluating Large Language Models on Wikipedia-Style Survey Generation ACL 2024 Findings of WMT 2024 Shared Task on Low-Resource Indic Languages Translation EMNLP 2024 Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation EMNLP 2024 Gaps or Hallucinations? Scrutinizing Machine-Generated Legal Analysis for Fine-grained Text Evaluations EMNLP 2024 How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024 HumanRankEval: Automatic Evaluation of LMs as Conversational Assistants NAACL 2024