conftrace_

krippendorff alpha

2 papers

Explore in graph

Co-occurring keywords · papers mentioning both

correlation metric (1) human uncertainty (1) inter-annotator agreement (1) machine translation evaluation (1) error annotation (1) automatic evaluation (1) jensen-shannon divergence (1) annotation quality (1) pearson correlation (1) statistical aggregation (1)

Papers

Beyond correlation: The impact of human uncertainty in measuring the effectiveness of automatic evaluation and LLM-as-a-judge ICLR 2025 On reporting scores and agreement for error annotation tasks EMNLP 2022