evaluation benchmark

Post Turing: Mapping the landscape of LLM Evaluation EMNLP 2023 QUDeval: The Evaluation of Questions Under Discussion Discourse Parsing EMNLP 2023 Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses EMNLP 2023 Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks EMNLP 2023 The Devil is in the Details: On the Pitfalls of Event Extraction Evaluation ACL 2023 ToMChallenges: A Principle-Guided Dataset and Diverse Evaluation Tasks for Exploring Theory of Mind CoNLL 2023 WYWEB: A NLP Evaluation Benchmark For Classical Chinese ACL 2023 Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair NAACL 2022 An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models ACL 2022 BECEL: Benchmark for Consistency Evaluation of Language Models COLING 2022 CLEVA-Compass: A Continual Learning Evaluation Assessment Compass to Promote Research Transparency and Comparability ICLR 2022 Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset EMNLP 2022 DiBiMT: A Novel Benchmark for Measuring Word Sense Disambiguation Biases in Machine Translation ACL 2022 Is NLP Ready for Standardization? EMNLP 2022 Measure and Improve Robustness in NLP Models: A Survey NAACL 2022 MT-GenEval: A Counterfactual and Contextual Dataset for Evaluating Gender Accuracy in Machine Translation EMNLP 2022 Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation COLING 2022 On the Effectiveness of Automated Metrics for Text Generation Systems EMNLP 2022 TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media COLING 2022 What Makes Data-to-Text Generation Hard for Pretrained Language Models? EMNLP 2022 BAHP: Benchmark of Assessing Word Embeddings in Historical Portuguese EMNLP 2021 Benchmarking: Past, Present and Future ACL 2021 FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN ACL 2021 RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems ACL 2021 Robustness Evaluation of Entity Disambiguation Using Prior Probes: the Case of Entity Overshadowing EMNLP 2021