benchmark evaluation

GLEMOS: Benchmark for Instantaneous Graph Learning Model Selection NeurIPS 2023 GLUECons: A Generic Benchmark for Learning under Constraints AAAI 2023 GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-Distribution Generalization Perspective ACL 2023 GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLP EMNLP 2023 GraphCleaner: Detecting Mislabelled Samples in Popular Graph Learning Benchmarks ICML 2023 Hi-ToM: A Benchmark for Evaluating Higher-Order Theory of Mind Reasoning in Large Language Models EMNLP 2023 Holistic Evaluation of Text-to-Image Models NeurIPS 2023 How hard are computer vision datasets? Calibrating dataset difficulty to viewing time NeurIPS 2023 How Predictable Are Large Language Model Capabilities? A Case Study on BIG-bench EMNLP 2023 HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Models ICCV 2023 IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning ACL 2023 Is GPT-4 a Good Data Analyst? EMNLP 2023 It’s about Time: Rethinking Evaluation on Rumor Detection Benchmarks using Chronological Splits EACL 2023 Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena NeurIPS 2023 Language models are not naysayers: an analysis of language models on negation benchmarks ACL 2023 Large Language Models Can Be Easily Distracted by Irrelevant Context ICML 2023 Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU EMNLP 2023 LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models NeurIPS 2023 LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal Domain EMNLP 2023 LMentry: A Language Model Benchmark of Elementary Language Tasks ACL 2023 Lo-Hi: Practical ML Drug Discovery Benchmark NeurIPS 2023 M3Exam: A Multilingual, Multimodal, Multilevel Benchmark for Examining Large Language Models NeurIPS 2023 „Mann“ is to “Donna” as「国王」is to « Reine » Adapting the Analogy Task for Multilingual and Contextual Embeddings ACL 2023 Mathematical Capabilities of ChatGPT NeurIPS 2023 Measuring Progress in Fine-grained Vision-and-Language Understanding ACL 2023