evaluation metric

STREAM: Spatio-TempoRal Evaluation and Analysis Metric for Video Generative Models ICLR 2024 Structured Tree Alignment for Evaluation of (Speech) Constituency Parsing ACL 2024 Systematic Task Exploration with LLMs: A Study in Citation Text Generation ACL 2024 Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability EMNLP 2024 Towards an Automated Pointwise Evaluation Metric for Generated Long-Form Legal Summaries EMNLP 2024 Towards Explainable Evaluation Metrics for Machine Translation JMLR 2024 Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolbox NeurIPS 2024 Towards Human-aligned Evaluation for Linear Programming Word Problems COLING 2024 Toward the Evaluation of Large Language Models Considering Score Variance across Instruction Templates EMNLP 2024 TOWER: Tree Organized Weighting for Evaluating Complex Instructions EMNLP 2024 Translation Canvas: An Explainable Interface to Pinpoint and Analyze Translation Systems EMNLP 2024 Tweak to Trust: Assessing the Reliability of Summarization Metrics in Contact Centers via Perturbed Summaries NAACL 2024 Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence NAACL 2024 VLEU: a Method for Automatic Evaluation for Generalizability of Text-to-Image Models EMNLP 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 X-ACE: Explainable and Multi-factor Audio Captioning Evaluation ACL 2024 A Benchmark for Evaluating Machine Translation Metrics on Dialects without Standard Orthography EMNLP 2023 ACCENT: An Automatic Event Commonsense Evaluation Metric for Open-Domain Dialogue Systems ACL 2023 Accuracy is not enough: Evaluating Personalization in Summarizers EMNLP 2023 A Critical Evaluation of Evaluations for Long-form Question Answering ACL 2023 AlignScore: Evaluating Factual Consistency with A Unified Alignment Function ACL 2023 Analyzing Multi-Sentence Aggregation in Abstractive Summarization via the Shapley Value EMNLP 2023 An Investigation of Evaluation Methods in Automatic Medical Note Generation ACL 2023 AraDiaWER: An Explainable Metric For Dialectical Arabic ASR EACL 2023 A Unified View of Evaluation Metrics for Structured Prediction EMNLP 2023