conftrace_

reference-free evaluation

93 papers

Explore in graph

Co-occurring keywords

large language model (13587) quality estimation (232) summarization evaluation (84) evaluation metric (573) machine translation (2499) reference-free metric (34) text summarization (896) automatic evaluation (225) factual consistency (126) text generation (2913)

Papers

Reference-Free Summarization Evaluation with Large Language Models AACL 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization CONLL 2023
Poor Man’s Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference EACL 2023
A Holistic Approach to Reference-Free Evaluation of Machine Translation ACL 2023
C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation ACL 2023
Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback ACL 2023
InfoMetIC: An Informative Metric for Reference-free Image Caption Evaluation ACL 2023
Towards Reference-free Text Simplification Evaluation with a BERT Siamese Network Architecture ACL 2023
RISE: Leveraging Retrieval Techniques for Summarization Evaluation ACL 2023
DocAsRef: An Empirical Study on Repurposing Reference-based Summary Quality Metrics as Reference-free Metrics EMNLP 2023
Benchmarking Foundation Models with Language-Model-as-an-Examiner NIPS 2023
EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching CVPR 2022
On the Limitations of Reference-Free Evaluations of Generated Text EMNLP 2022
SueNes: A Weakly Supervised Approach to Evaluating Single-Document Summarization via Negative Sampling NAACL 2022
MaTESe: Machine Translation Evaluation as a Sequence Tagging Problem EMNLP 2022
HaRiM+: Evaluating Summary Quality with Hallucination Risk AACL 2022
QSTS: A Question-Sensitive Text Similarity Measure for Question Generation COLING 2022
REUSE: REference-free UnSupervised Quality Estimation Metric EMNLP 2022
A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text Generation ACL 2022
Learning to Rank Visual Stories From Human Ranking Data ACL 2022
FlowEval: A Consensus-Based Dialogue Evaluation Framework Using Segment Act Flows EMNLP 2022
Spurious Correlations in Reference-Free Evaluation of Text Generation ACL 2022
PrefScore: Pairwise Preference Learning for Reference-free Summarization Quality Assessment COLING 2022
Reference-free Summarization Evaluation via Semantic Correlation and Compression Ratio NAACL 2022
COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task EMNLP 2022