conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Exploring Prompting Large Language Models as Explainable Metrics IJCNLP 2023
Multi Document Summarization Evaluation in the Presence of Damaging Content EMNLP 2023
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics EMNLP 2023
Analyzing Multi-Sentence Aggregation in Abstractive Summarization via the Shapley Value EMNLP 2023
Accuracy is not enough: Evaluating Personalization in Summarizers EMNLP 2023
Ranger: A Toolkit for Effect-Size Based Multi-Task Evaluation ACL 2023
IAEval: A Comprehensive Evaluation of Instance Attribution on Natural Language Understanding EMNLP 2023
FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text Generation EMNLP 2023
Little Giants: Exploring the Potential of Small LLMs as Evaluation Metrics in Summarization in the Eval4NLP 2023 Shared Task IJCNLP 2023
An Investigation of Evaluation Methods in Automatic Medical Note Generation ACL 2023
DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation ACL 2023
AlignScore: Evaluating Factual Consistency with A Unified Alignment Function ACL 2023
Rogue Scores ACL 2023
Is ChatGPT a Good NLG Evaluator? A Preliminary Study EMNLP 2023
Hiding in Plain Sight: Insights into Abstractive Text Summarization EACL 2023
Delving into Evaluation Metrics for Generation: A Thorough Assessment of How Metrics Generalize to Rephrasing Across Languages IJCNLP 2023
WRF: Weighted Rouge-F1 Metric for Entity Recognition IJCNLP 2023
Re-Examining Summarization Evaluation across Multiple Quality Criteria EMNLP 2023
Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks EMNLP 2023
Evaluating Evaluation Metrics: A Framework for Analyzing NLG Evaluation Metrics using Measurement Theory EMNLP 2023
CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code EMNLP 2023
Exploring Context-Aware Evaluation Metrics for Machine Translation EMNLP 2023
Fair Enough: Standardizing Evaluation and Model Selection for Fairness Research in NLP EACL 2023
EffEval: A Comprehensive Evaluation of Efficiency for MT Evaluation Metrics EMNLP 2023
Towards Reliable Item Sampling for Recommendation Evaluation AAAI 2023