evaluation benchmark

MultifacetEval: Multifaceted Evaluation to Probe LLMs in Mastering Medical Knowledge IJCAI 2024 Multi-Object Hallucination in Vision Language Models NeurIPS 2024 Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NeurIPS 2024 OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI NeurIPS 2024 On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation ACL 2024 Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmark ACL 2024 PizzaCommonSense: A Dataset for Commonsense Reasoning about Intermediate Steps in Cooking Recipes EMNLP 2024 PrivacyLens: Evaluating Privacy Norm Awareness of Language Models in Action NeurIPS 2024 Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation ACL 2024 PromptBench: A Unified Library for Evaluation of Large Language Models JMLR 2024 QGEval: Benchmarking Multi-dimensional Evaluation for Question Generation EMNLP 2024 RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question Answering EMNLP 2024 S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Model NAACL 2024 SilverAlign: MT-Based Silver Data Algorithm for Evaluating Word Alignment COLING 2024 Stress-Testing Long-Context Language Models with Lifelong ICL and Task Haystack NeurIPS 2024 SUGARCREPE++ Dataset: Vision-Language Model Sensitivity to Semantic and Lexical Alterations NeurIPS 2024 SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories EMNLP 2024 Susu Box or Piggy Bank: Assessing Cultural Commonsense Knowledge between Ghana and the US EMNLP 2024 T-Eval: Evaluating the Tool Utilization Capability of Large Language Models Step by Step ACL 2024 Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability EMNLP 2024 Toward a Stable, Fair, and Comprehensive Evaluation of Object Hallucination in Large Vision-Language Models NeurIPS 2024 Towards the TopMost: A Topic Modeling System Toolkit ACL 2024 Uncovering Stereotypes in Large Language Models: A Task Complexity-based Approach EACL 2024 Unveiling Strengths and Weaknesses of NLP Systems Based on a Rich Evaluation Corpus: The Case of NER in French COLING 2024 VBench: Comprehensive Benchmark Suite for Video Generative Models CVPR 2024