Evaluation

IsoScore: Measuring the Uniformity of Embedding Space Utilization ACL 2022 Iteratively Selecting an Easy Reference Frame Makes Unsupervised Video Object Segmentation Easier AAAI 2022 Iterative Stratified Testing and Measurement for Automated Model Updates EMNLP 2022 Just Rank: Rethinking Evaluation with Word and Sentence Similarities ACL 2022 KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models EMNLP 2022 Language Models Are Poor Learners of Directional Inference EMNLP 2022 Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA EMNLP 2022 Layer or Representation Space: What Makes BERT-based Evaluation Metrics Robust? COLING 2022 LexGLUE: A Benchmark Dataset for Legal Language Understanding in English ACL 2022 Life after BERT: What do Other Muppets Understand about Language? ACL 2022 Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set EMNLP 2022 Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions EMNLP 2022 Local Structure Matters Most in Most Languages AACL 2022 Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language Inference EMNLP 2022 LSCDiscovery: A shared task on semantic change discovery and detection in Spanish ACL 2022 Machine translation impact in E-commerce multilingual search EMNLP 2022 MDD-Eval: Self-Training on Augmented Data for Multi-Domain Dialogue Evaluation AAAI 2022 Measure and Improve Robustness in NLP Models: A Survey NAACL 2022 Measuring and Improving Semantic Diversity of Dialogue Generation EMNLP 2022 Measuring Compositional Consistency for Video Question Answering CVPR 2022 Measuring Robustness for NLP COLING 2022 Measuring the Measuring Tools: An Automatic Evaluation of Semantic Metrics for Text Corpora EMNLP 2022 Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering COLING 2022 Modeling the Machine Learning Multiverse NeurIPS 2022 MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction NAACL 2022