automatic evaluation

VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NeurIPS 2023 Assessing Inter-metric Correlation for Multi-document Summarization Evaluation EMNLP 2022 A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ACL 2022 Automatically Discarding Straplines to Improve Data Quality for Abstractive News Summarization ACL 2022 Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ACL 2022 Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems AACL 2022 CodeExp: Explanatory Code Document Generation EMNLP 2022 Ditch the Gold Standard: Re-evaluating Conversational Question Answering ACL 2022 Does GPT-3 Generate Empathetic Dialogues? A Novel In-Context Example Selection Method and Automatic Evaluation Metric for Empathetic Dialogue Generation COLING 2022 Does Summary Evaluation Survive Translation to Other Languages? NAACL 2022 Evaluating the Knowledge Dependency of Questions EMNLP 2022 Exploring Robustness of Machine Translation Metrics: A Study of Twenty-Two Automatic Metrics in the WMT22 Metric Task EMNLP 2022 How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluation COLING 2022 Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ACL 2022 IM2: an Interpretable and Multi-category Integrated Metric Framework for Automatic Dialogue Evaluation EMNLP 2022 IMPARA: Impact-Based Metric for GEC Using Parallel Data COLING 2022 Improving abstractive summarization with energy-based re-ranking EMNLP 2022 Learning to Rank Visual Stories From Human Ranking Data ACL 2022 Linguistic Corpus Annotation for Automatic Text Simplification Evaluation EMNLP 2022 Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora EMNLP 2022 Modeling Exemplification in Long-form Question Answering via Retrieval NAACL 2022 Near-Negative Distinction: Giving a Second Life to Human Evaluation Datasets EMNLP 2022 Open-Domain Dialog Evaluation Using Follow-Ups Likelihood COLING 2022 Overview of the 9th Workshop on Asian Translation COLING 2022 Quality Estimation via Backtranslation at the WMT 2022 Quality Estimation Task EMNLP 2022