semantic evaluation

An LLM-based Quantitative Framework for Evaluating High-Stealthy Backdoor Risks in OSS Supply Chains AAAI 2026 Disentangling Emotion Understanding and Generation in Large Language Models EACL 2026 SafeSieve: From Heuristics to Experience in Progressive Pruning for LLM-based Multi-Agent Communication AAAI 2026 Assessing the Sensitivity and Alignment of FOL Closeness Metrics EMNLP 2025 ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering ICCV 2025 Measuring Contextual Informativeness in Child-Directed Text COLING 2025 SEOE: A Scalable and Reliable Semantic Evaluation Framework for Open Domain Event Detection ACL 2025 TableEval: A Real-World Benchmark for Complex, Multilingual, and Multi-Structured Table Question Answering EMNLP 2025 Thank You, Stingray: Multilingual Large Language Models Can Not (Yet) Disambiguate Cross-Lingual Word Senses NAACL 2025 The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs EMNLP 2025 Accurate and Nuanced Open-QA Evaluation Through Textual Entailment ACL 2024 CodeJudge: Evaluating Code Generation with Large Language Models EMNLP 2024 GEAR: Augmenting Language Models with Generalizable and Efficient Tool Resolution EACL 2024 Is This a Bad Table? A Closer Look at the Evaluation of Table Generation from Text EMNLP 2024 KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation ACL 2024 SemEval-2024 Task 5: Argument Reasoning in Civil Procedure SemEval 2024 AraDiaWER: An Explainable Metric For Dialectical Arabic ASR EACL 2023 Pre-trained language models evaluating themselves - A comparative study ACL 2022 RACAI at SemEval-2022 Task 11: Complex named entity recognition using a lateral inhibition mechanism SemEval 2022 Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? ACL 2022 Data-QuestEval: A Referenceless Metric for Data-to-Text Semantic Evaluation EMNLP 2021 Evaluating Text Generation from Discourse Representation Structures ACL 2021 On Sample Based Explanation Methods for NLP: Faithfulness, Efficiency and Semantic Evaluation ACL 2021 SMURF: SeMantic and linguistic UndeRstanding Fusion for Caption Evaluation via Typicality Analysis ACL 2021 What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP EMNLP 2021