Evaluation

BECEL: Benchmark for Consistency Evaluation of Language Models COLING 2022 BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation ACL 2022 Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ACL 2022 Benchmarking Intersectional Biases in NLP NAACL 2022 Benchopt: Reproducible, efficient and collaborative optimization benchmarks NeurIPS 2022 Better Uncertainty Calibration via Proper Scores for Classification and Beyond NeurIPS 2022 Beyond Static models and test sets: Benchmarking the potential of pre-trained models across tasks and languages ACL 2022 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand NAACL 2022 Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems AACL 2022 BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation NAACL 2022 Calibration Error for Heterogeneous Treatment Effects AISTATS 2022 Can Edge Probing Tests Reveal Linguistic Knowledge in QA Models? COLING 2022 Can Transformers Process Recursive Nested Constructions, Like Humans? COLING 2022 Cascading Biases: Investigating the Effect of Heuristic Annotation Strategies on Data and Models EMNLP 2022 CGLB: Benchmark Tasks for Continual Graph Learning NeurIPS 2022 ChatMatch: Evaluating Chatbots by Autonomous Chat Tournaments ACL 2022 Clustering Examples in Multi-Dataset Benchmarks with Item Response Theory ACL 2022 ConferencingSpeech 2022 Challenge: Non-intrusive Objective Speech Quality Assessment (NISQA) Challenge for Online Conferencing Applications Interspeech 2022 Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics EMNLP 2022 Continuous Rating as Reliable Human Evaluation of Simultaneous Speech Translation EMNLP 2022 Contrast Sets for Stativity of English Verbs in Context COLING 2022 COPEN: Probing Conceptual Knowledge in Pre-trained Language Models EMNLP 2022 CS-Shapley: Class-wise Shapley Values for Data Valuation in Classification NeurIPS 2022 CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation ACL 2022 Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding NAACL 2022