Evaluation

StoryDB: Broad Multi-language Narrative Dataset EMNLP 2021 Stream-level Latency Evaluation for Simultaneous Machine Translation EMNLP 2021 Subjective Evaluation of Noise Suppression Algorithms in Crowdsourcing Interspeech 2021 Surrogate Regret Bounds for Polyhedral Losses NeurIPS 2021 TabPert : An Effective Platform for Tabular Perturbation EMNLP 2021 Targeting the Benchmark: On Methodology in Current Natural Language Processing Research ACL 2021 Testing Cross-Database Semantic Parsers With Canonical Utterances EMNLP 2021 The Acceptability Delta Criterion: Testing Knowledge of Language using the Gradience of Sentence Acceptability EMNLP 2021 The Eval4NLP Shared Task on Explainable Quality Estimation: Overview and Results EMNLP 2021 The Gap on Gap: Tackling the Problem of Differing Data Distributions in Bias-Measuring Datasets AAAI 2021 The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation EMNLP 2021 The statistical advantage of automatic NLG metrics at the system level ACL 2021 Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding EMNLP 2021 To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation EMNLP 2021 Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMR EACL 2021 Towards a more Robust Evaluation for Conversational Question Answering ACL 2021 Towards Benchmarking the Utility of Explanations for Model Debugging NAACL 2021 Towards the evaluation of automatic simultaneous speech translation from a communicative perspective ACL 2021 Trainable Ranking Models to Evaluate the Semantic Accuracy of Data-to-Text Neural Generator EMNLP 2021 Training Dynamic based data filtering may not work for NLP datasets EMNLP 2021 Troubleshooting Blind Image Quality Models in the Wild CVPR 2021 Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metrics NAACL 2021 Validating Label Consistency in NER Data Annotation EMNLP 2021 Verifiability and Predictability: Interpreting Utilities of Network Architectures for Point Cloud Processing CVPR 2021 We Need to Consider Disagreement in Evaluation ACL 2021