conftrace_

reference-free evaluation

93 papers

Explore in graph

Co-occurring keywords

large language model (13587) quality estimation (232) summarization evaluation (84) evaluation metric (573) machine translation (2499) reference-free metric (34) text summarization (896) automatic evaluation (225) factual consistency (126) text generation (2913)

Papers

From Model-centered to Human-Centered: Revision Distance as a Metric for Text Evaluation in LLMs-based Applications ACL 2024
SocREval: Large Language Models with the Socratic Method for Reference-free Reasoning Evaluation NAACL 2024
Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean COLING 2024
Reference-Free Estimation of the Quality of Clinical Notes Generated from Doctor-Patient Conversations INTERSPEECH 2024
An Examination of the Robustness of Reference-Free Image Captioning Evaluation Metrics EACL 2024
How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs? EMNLP 2024
Reference-based Metrics Disprove Themselves in Question Generation EMNLP 2024
CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses NIPS 2024
Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability EMNLP 2024
Towards a Scalable Reference-Free Evaluation of Generative Models NIPS 2024
LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores ACL 2024
SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window NAACL 2024
BLASER 2.0: a metric for evaluation and quality estimation of massively multilingual speech and text translation EMNLP 2024
FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Model ACL 2024
Ranking Large Language Models without Ground Truth ACL 2024
G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment EMNLP 2023
UMSE: Unified Multi-scenario Summarization Evaluation ACL 2023
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question ACL 2023
Evaluating Factual Consistency of Texts with Semantic Role Labeling ACL 2023
Reference-Free Summarization Evaluation with Large Language Models IJCNLP 2023
A Reference-free Segmentation Quality Index (SegReFree) EMNLP 2023
Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization EMNLP 2023
Quality Estimation Using Minimum Bayes Risk EMNLP 2023
Rethinking Round-Trip Translation for Machine Translation Evaluation ACL 2023
PR-MCS: Perturbation Robust Metric for MultiLingual Image Captioning EMNLP 2023