Evaluation

Paradise at SemEval-2026 Task 5: On the Limitations of Surface-Level Features for Graded Word Sense Plausibility Prediction SemEval 2026 PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection ACL 2026 Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering ACL 2026 Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation ACL 2026 ReFEree: Reference-Free and Fine-Grained Method for Evaluating Factual Consistency in Real-World Code Summarization ACL 2026 ReflectRM: Boosting Generative Reward Models via Self-Reflection within a Unified Judgment Framework ACL 2026 Repeated Sequences Reveal Gaps between Large Language Models and Natural Language ACL 2026 Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models ACL 2026 Revisiting Evaluation of Question Answering Systems in Low-Resource Indic Languages: Bridging Human and Metric Alignment ACL 2026 Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages ACL 2026 Reward Modeling for Scientific Writing Evaluation ACL 2026 ROSE: An Intent-Centered Evaluation Metric for NL2SQL ACL 2026 RubricBench: Aligning Model-Generated Rubrics with Human Standards ACL 2026 Semantic Span Annotation: An Exploratory Study of LLM Annotation ACL 2026 SemEval-2026 Task 1: MWAHAHA, Models Write Automatic Humor And Humans Annotate SemEval 2026 SemEval-2026 Task 5: Rating Plausibility of Word Senses in Ambiguous Stories through Narrative Understanding SemEval 2026 SemEval-2026 Task 8: MTRAGEval: Evaluating Multi-Turn RAG Conversations SemEval 2026 Sigmoid Head for Quality Estimation under Language Ambiguity ACL 2026 SkMTEB: Slovak Massive Text Embedding Benchmark and Model Adaptation ACL 2026 SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks ACL 2026 Stereotype Bias in a Bilingual Setting: A Culturally Grounded Evaluation in Kazakhstan ACL 2026 Stress Testing Factual Consistency Metrics for Long-Document Summarization ACL 2026 Subject-level Inference for Realistic Text Anonymization Evaluation ACL 2026 SwissGov-RSD: A Human-annotated, Cross-lingual Benchmark for Token-level Recognition of Semantic Differences Between Related Documents ACL 2026 TEA-Bench: A Systematic Benchmarking of Tool-enhanced Emotional Support Dialogue Agent ACL 2026