metric evaluation

Assessing the Sensitivity and Alignment of FOL Closeness Metrics EMNLP 2025 Contextual Metric Meta-Evaluation by Measuring Local Metric Accuracy NAACL 2025 Evaluating Sequence Labeling on the basis of Information Theory ACL 2025 Evaluating the Evaluators: Are readability metrics good measures of readability? EMNLP 2025 Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help EMNLP 2025 Has Machine Translation Evaluation Achieved Human Parity? The Human Reference and the Limits of Progress ACL 2025 Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level Aggregation AAAI 2025 Verify with Caution: The Pitfalls of Relying on Imperfect Factuality Metrics ACL 2025 BMX: Boosting Natural Language Generation Metrics with Explainability EACL 2024 Decoding the Metrics Maze: Navigating the Landscape of Conversational Question Answering System Evaluation in Procedural Tasks COLING 2024 Evaluating Automatic Metrics with Incremental Machine Translation Systems EMNLP 2024 Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In! ACL 2024 MetaMetrics-MT: Tuning Meta-Metrics for Machine Translation via Human Preference Calibration EMNLP 2024 MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality EMNLP 2024 MSLC24 Submissions to the General Machine Translation Task EMNLP 2024 Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NeurIPS 2024 On the Content Bias in Frechet Video Distance CVPR 2024 Overcoming Common Flaws in the Evaluation of Selective Classification Systems NeurIPS 2024 Pitfalls and Outlooks in Using COMET EMNLP 2024 Reproducing the Metric-Based Evaluation of a Set of Controllable Text Generation Techniques COLING 2024 Unveiling the Achilles’ Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models ACL 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 Extrinsic Evaluation of Machine Translation Metrics ACL 2023 FactSpotter: Evaluating the Factual Faithfulness of Graph-to-Text Generation EMNLP 2023 IndicMT Eval: A Dataset to Meta-Evaluate Machine Translation Metrics for Indian Languages ACL 2023