evaluation metric

Granular Change Accuracy: A More Accurate Performance Metric for Dialogue State Tracking COLING 2024 Human-Centered Design Recommendations for LLM-as-a-judge ACL 2024 ICE-Score: Instructing Large Language Models to Evaluate Code EACL 2024 Image-aware Evaluation of Generated Medical Reports NeurIPS 2024 Improving Automatic VQA Evaluation Using Large Language Models AAAI 2024 Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy EMNLP 2024 I Need Help! Evaluating LLM’s Ability to Ask for Users’ Support: A Case Study on Text-to-SQL Generation EMNLP 2024 IsoChronoMeter: A Simple and Effective Isochronic Translation Evaluation Metric EMNLP 2024 Is Reference Necessary in the Evaluation of NLG Systems? When and Where? NAACL 2024 Keyphrase Generation: Lessons from a Reproducibility Study COLING 2024 KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation ACL 2024 Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction NAACL 2024 Leveraging Large Language Models for NLG Evaluation: Advances and Challenges EMNLP 2024 LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores ACL 2024 LongDocFACTScore: Evaluating the Factuality of Long Document Abstractive Summarisation COLING 2024 Machine Unlearning: Challenges in Data Quality and Access IJCAI 2024 Meta-Evaluation of Sentence Simplification Metrics COLING 2024 MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task EMNLP 2024 MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024 MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality EMNLP 2024 Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies ACL 2024 Neural Multimodal Topic Modeling: A Comprehensive Evaluation COLING 2024 Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References NAACL 2024 On Measuring Context Utilization in Document-Level MT Systems EACL 2024 On the Content Bias in Frechet Video Distance CVPR 2024