benchmark evaluation

Med-HALT: Medical Domain Hallucination Test for Large Language Models CoNLL 2023 MoQA: Benchmarking Multi-Type Open-Domain Question Answering ACL 2023 Movie101: A New Movie Understanding Benchmark ACL 2023 Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking ACL 2023 MTEB: Massive Text Embedding Benchmark EACL 2023 Multi-lingual Evaluation of Code Generation Models ICLR 2023 MultiRobustBench: Benchmarking Robustness Against Multiple Attacks ICML 2023 MultiZoo and MultiBench: A Standardized Toolkit for Multimodal Deep Learning JMLR 2023 NEWTON: Are Large Language Models Capable of Physical Reasoning? EMNLP 2023 NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark EMNLP 2023 NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing ACL 2023 NusaCrowd: Open Source Initiative for Indonesian NLP Resources ACL 2023 OceanBench: The Sea Surface Height Edition NeurIPS 2023 On Evaluation of Document Classification with RVL-CDIP EACL 2023 On Pitfalls of Test-Time Adaptation ICML 2023 On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research EMNLP 2023 On using distribution-based compositionality assessment to evaluate compositional generalisation in machine translation EMNLP 2023 OpenDataVal: a Unified Benchmark for Data Valuation NeurIPS 2023 OpenGSL: A Comprehensive Benchmark for Graph Structure Learning NeurIPS 2023 OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning NeurIPS 2023 ORCA: A Challenging Benchmark for Arabic Language Understanding ACL 2023 PIXIU: A Comprehensive Benchmark, Instruction Dataset and Large Language Model for Finance NeurIPS 2023 Post Turing: Mapping the landscape of LLM Evaluation EMNLP 2023 Pseudointelligence: A Unifying Lens on Language Model Evaluation EMNLP 2023 Quantifying Train-Evaluation Overlap with Nearest Neighbors ACL 2023