conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

Unlocking Structure Measuring: Introducing PDD, an Automatic Metric for Positional Discourse Coherence NAACL 2024
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation NIPS 2024
SeMaScore: A new evaluation metric for automatic speech recognition tasks INTERSPEECH 2024
GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation CVPR 2024
ROUGE-K: Do Your Summaries Have Keywords? NAACL 2024
Combining Multiple Metrics for Evaluating Retrieval-Augmented Conversations NAACL 2024
MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task EMNLP 2024
Meta-Evaluation of Sentence Simplification Metrics COLING 2024
A Survey of Learning Criteria Going beyond the Usual Risk (Abstract Reprint) AAAI 2024
Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy EMNLP 2024
SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translation COLING 2024
Keyphrase Generation: Lessons from a Reproducibility Study COLING 2024
Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking COLING 2024
I Need Help! Evaluating LLM’s Ability to Ask for Users’ Support: A Case Study on Text-to-SQL Generation EMNLP 2024
Rethinking FID: Towards a Better Evaluation Metric for Image Generation CVPR 2024
SIERA: An Evaluation Metric for Text Simplification using the Ranking Model and Data Augmentation by Edit Operations COLING 2024
Tweak to Trust: Assessing the Reliability of Summarization Metrics in Contact Centers via Perturbed Summaries NAACL 2024
chrF-S: Semantics Is All You Need EMNLP 2024
Assessing Image-Captioning Models: A Novel Framework Integrating Statistical Analysis and Metric Patterns COLING 2024
MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality EMNLP 2024
Towards Human-aligned Evaluation for Linear Programming Word Problems COLING 2024
Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024
DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation ACL 2024
Small Objects Matters in Weakly-Supervised Semantic Segmentation WACV 2024
On the Content Bias in Frechet Video Distance CVPR 2024