machine translation evaluation

Dynamic Meta-Metrics: Source-Sentence Conditioned Weighting for MT Evaluation ACL 2026 ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation IJCNLP 2025 Evaluating WMT 2025 Metrics Shared Task Submissions on the SSA-MTE African Challenge Set EMNLP 2025 FUSE : A Ridge and Random Forest-Based Metric for Evaluating MT in Indigenous Languages NAACL 2025 LiTransProQA: An LLM-based Literary Translation Evaluation Metric with Professional Question Answering EMNLP 2025 M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluation ACL 2025 MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluators COLING 2025 Refined Assessment for Translation Evaluation: Rethinking Machine Translation Evaluation in the Era of Human-Level Systems EMNLP 2025 ReMedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling EMNLP 2025 RUBRIC-MQM : Span-Level LLM-as-judge in Machine Translation For High-End Models ACL 2025 Same evaluation, more tokens: On the effect of input length for machine translation evaluation using Large Language Models EMNLP 2025 Tagged Span Annotation for Detecting Translation Errors in Reasoning LLMs EMNLP 2025 AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages NAACL 2024 BLASER 2.0: a metric for evaluation and quality estimation of massively multilingual speech and text translation EMNLP 2024 Can Automatic Metrics Assess High-Quality Translations? EMNLP 2024 chrF-S: Semantics Is All You Need EMNLP 2024 COMET for Low-Resource Machine Translation Evaluation: A Case Study of English-Maltese and Spanish-Basque COLING 2024 Lost in the Source Language: How Large Language Models Evaluate the Quality of Machine Translation ACL 2024 MMTE: Corpus and Metrics for Evaluating Machine Translation Quality of Metaphorical Language EMNLP 2024 MSLC24: Further Challenges for Metrics on a Wide Landscape of Translation Quality EMNLP 2024 PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluation EMNLP 2024 Towards Multiple References Era – Addressing Data Leakage and Limited Reference Diversity in Machine Translation Evaluation ACL 2024 What do Large Language Models Need for Machine Translation Evaluation? EMNLP 2024 xCOMET-lite: Bridging the Gap Between Efficiency and Quality in Learned MT Evaluation Metrics EMNLP 2024 Automatic Evaluation and Analysis of Idioms in Neural Machine Translation EACL 2023