conftrace_

evaluation metric

573 papers

Explore in graph

Co-occurring keywords

machine translation (2499) large language model (13587) text generation (2913) natural language generation (785) automatic evaluation (225) human evaluation (379) text summarization (896) language model (4599) question answering (2963) translation quality (224)

Papers

How Far are We from Robust Long Abstractive Summarization? EMNLP 2022
QSTS: A Question-Sensitive Text Similarity Measure for Question Generation COLING 2022
Over-Generation Cannot Be Rewarded: Length-Adaptive Average Lagging for Simultaneous Speech Translation NAACL 2022
Reproducibility Issues for BERT-based Evaluation Metrics EMNLP 2022
Revisiting Grammatical Error Correction Evaluation and Beyond EMNLP 2022
DEMETR: Diagnosing Evaluation Metrics for Translation EMNLP 2022
An Alignment-based Approach to Text Segmentation Similarity Scoring EMNLP 2022
Improved Evaluation of Automatic Source Code Summarisation EMNLP 2022
Assessing Inter-metric Correlation for Multi-document Summarization Evaluation EMNLP 2022
Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set EMNLP 2022
PDEBench: An Extensive Benchmark for Scientific Machine Learning NIPS 2022
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code EMNLP 2022
IM2: an Interpretable and Multi-category Integrated Metric Framework for Automatic Dialogue Evaluation EMNLP 2022
SimQA: Detecting Simultaneous MT Errors through Word-by-Word Question Answering EMNLP 2022
Evaluating the Knowledge Dependency of Questions EMNLP 2022
Don’t Copy the Teacher: Data and Model Challenges in Embodied Dialogue EMNLP 2022
Rethinking and Refining the Distinct Metric ACL 2022
Learning to Rank Visual Stories From Human Ranking Data ACL 2022
Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? ACL 2022
SubER - A Metric for Automatic Evaluation of Subtitle Quality ACL 2022
Disentangling Uncertainty in Machine Translation Evaluation EMNLP 2022
Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric ACL 2022
Evaluating Extreme Hierarchical Multi-label Classification ACL 2022
FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metrics for Automatic Text Generation ACL 2022
Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics ACL 2022