conftrace_

evaluation reliability

5 papers

Explore in graph

Co-occurring keywords · papers mentioning both

participant demographics (1) evaluation consistency (1) collective judgment (1) judgment consistency (1) reference-free metric (1) dataset annotation (1) adversarial dataset (1) multilingual evaluation (1) social bia (1) human evaluation (1)

Papers

How Reliable is Multilingual LLM-as-a-Judge? EMNLP 2025 Is Your Video Language Model a Reliable Judge? ICLR 2025 Reliability Crisis of Reference-free Metrics for Grammatical Error Correction EMNLP 2025 Reliability of Human Evaluation for Text Summarization: Lessons Learned and Challenges Ahead EACL 2021 What Will it Take to Fix Benchmarking in Natural Language Understanding? NAACL 2021