conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

How Much Consistency Is Your Accuracy Worth? EMNLP 2023
JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models EMNLP 2023
Measuring Faithful and Plausible Visual Grounding in VQA EMNLP 2023
Towards Reliable Item Sampling for Recommendation Evaluation AAAI 2023
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation ACL 2023
HAUSER: Towards Holistic and Automatic Evaluation of Simile Generation ACL 2023
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question ACL 2023
Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark ACL 2023
Data Sampling and (In)stability in Machine Translation Evaluation ACL 2023
Findings of the AmericasNLP 2023 Shared Task on Machine Translation into Indigenous Languages ACL 2023
GROOViST: A Metric for Grounding Objects in Visual Storytelling EMNLP 2023
CLEME: Debiasing Multi-reference Evaluation for Grammatical Error Correction EMNLP 2023
G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment EMNLP 2023
PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning EMNLP 2023
Exploring Context-Aware Evaluation Metrics for Machine Translation EMNLP 2023
FACE: Evaluating Natural Language Generation with Fourier Analysis of Cross-Entropy NIPS 2023
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation NIPS 2023
Feature Likelihood Divergence: Evaluating the Generalization of Generative Models Using Samples NIPS 2023
WRF: Weighted Rouge-F1 Metric for Entity Recognition AACL 2023
Summary Cycles: Exploring the Impact of Prompt Engineering on Large Language Models’ Interaction with Interaction Log Information AACL 2023
DATScore: Evaluating Translation with Data Augmented Translations EACL 2023
SMATCH++: Standardized and Extended Evaluation of Semantic Graphs EACL 2023
Pulling Out All The Full Stops: Punctuation Sensitivity in Neural Machine Translation and Evaluation ACL 2023
Multi-Dimensional Evaluation of Text Summarization with In-Context Learning ACL 2023
Identifying Context-Dependent Translations for Evaluation Set Production EMNLP 2023