Evaluation

Rethinking and Refining the Distinct Metric ACL 2022 Rethinking Knowledge Graph Evaluation Under the Open-World Assumption NeurIPS 2022 [RETRACTED] NLG-Metricverse: An End-to-End Library for Evaluating Natural Language Generation COLING 2022 Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE? ACL 2022 Revisiting DocRED - Addressing the False Negative Problem in Relation Extraction EMNLP 2022 Revisiting Grammatical Error Correction Evaluation and Beyond EMNLP 2022 Revisiting text decomposition methods for NLI-based factuality scoring of summaries EMNLP 2022 RobustLR: A Diagnostic Benchmark for Evaluating Logical Robustness of Deductive Reasoners EMNLP 2022 Sarcasm Detection is Way Too Easy! An Empirical Comparison of Human and Machine Sarcasm Detection EMNLP 2022 Scientific and Creative Analogies in Pretrained Language Models EMNLP 2022 SEAL: Interactive Tool for Systematic Error Analysis and Labeling EMNLP 2022 Searching for a Higher Power in the Human Evaluation of MT EMNLP 2022 Semantic Shift Stability: Efficient Way to Detect Performance Degradation of Word Embeddings and Pre-trained Language Models AACL 2022 SEM-F1: an Automatic Way for Semantic Evaluation of Multi-Narrative Overlap Summaries at Scale EMNLP 2022 SHAP-Based Explanation Methods: A Review for NLP Interpretability COLING 2022 Simple but Challenging: Natural Language Inference Models Fail on Simple Sentences EMNLP 2022 Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions ACL 2022 SLING: Sino Linguistic Evaluation of Large Language Models EMNLP 2022 SQuALITY: Building a Long-Document Summarization Dataset the Hard Way EMNLP 2022 SRL4E – Semantic Role Labeling for Emotions: A Unified Evaluation Framework ACL 2022 Stability of Syntactic Dialect Classification over Space and Time COLING 2022 Stable Conformal Prediction Sets ICML 2022 Stop Measuring Calibration When Humans Disagree EMNLP 2022 Structurally Diverse Sampling for Sample-Efficient Training and Comprehensive Evaluation EMNLP 2022 SubER - A Metric for Automatic Evaluation of Subtitle Quality ACL 2022