benchmark evaluation

The Skipped Beat: A Study of Sociopragmatic Understanding in LLMs for 64 Languages EMNLP 2023 The Tail Wagging the Dog: Dataset Construction Biases of Social Bias Benchmarks ACL 2023 The UNLP 2023 Shared Task on Grammatical Error Correction for Ukrainian EACL 2023 The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks CoNLL 2023 Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models EMNLP 2023 Towards Explainable and Accessible AI EMNLP 2023 Towards Fair and Comprehensive Comparisons for Image-Based 3D Object Detection ICCV 2023 Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages ACL 2023 Towards Reasoning in Large Language Models: A Survey ACL 2023 Toward Stronger Textual Attack Detectors EMNLP 2023 ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversation EMNLP 2023 Transitioning from benchmarks to a real-world case of information-seeking in Scientific Publications ACL 2023 True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-4 ACL 2023 UINAUIL: A Unified Benchmark for Italian Natural Language Understanding ACL 2023 Understanding Social Reasoning in Language Models with Language Models NeurIPS 2023 USB: A Unified Summarization Benchmark Across Tasks and Domains EMNLP 2023 VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models NeurIPS 2023 We’re Afraid Language Models Aren’t Modeling Ambiguity EMNLP 2023 What a MESS: Multi-Domain Evaluation of Zero-Shot Semantic Segmentation NeurIPS 2023 What Do NLP Researchers Believe? Results of the NLP Community Metasurvey ACL 2023 What’s the Meaning of Superhuman Performance in Today’s NLU? ACL 2023 When to Use What: An In-Depth Comparative Empirical Analysis of OpenIE Systems for Downstream Applications ACL 2023 Why Aren’t We NER Yet? Artifacts of ASR Errors in Named Entity Recognition in Spontaneous Speech Transcripts ACL 2023 WikiHowQA: A Comprehensive Benchmark for Multi-Document Non-Factoid Question Answering ACL 2023 XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages EMNLP 2023