evaluation benchmark

ViLCo-Bench: VIdeo Language COntinual learning Benchmark NeurIPS 2024 Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles NeurIPS 2024 ZSC-Eval: An Evaluation Toolkit and Benchmark for Multi-agent Zero-shot Coordination NeurIPS 2024 A Better Way to Do Masked Language Model Scoring ACL 2023 A Comprehensive Evaluation of Biomedical Entity Linking Models EMNLP 2023 Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of Arabic EMNLP 2023 BiasBed - Rigorous Texture Bias Evaluation CVPR 2023 Blackbird language matrices (BLM), a new task for rule-like generalization in neural networks: Can Large Language Models pass the test? EMNLP 2023 Can we trust the evaluation on ChatGPT? ACL 2023 CCEval: A Representative Evaluation Benchmark for the Chinese-centric Multilingual Machine Translation EMNLP 2023 Considerations for meaningful sign language machine translation based on glosses ACL 2023 CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion NeurIPS 2023 DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models ICCV 2023 EVALIGN: Visual Evaluation of Translation Alignment Models EACL 2023 Evaluating Object Hallucination in Large Vision-Language Models EMNLP 2023 FERMAT: An Alternative to Accuracy for Numerical Reasoning ACL 2023 GLUE-X: Evaluating Natural Language Understanding Models from an Out-of-Distribution Generalization Perspective ACL 2023 GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization ACL 2023 HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Models EMNLP 2023 How Well Do Large Language Models Perform on Faux Pas Tests? ACL 2023 INVITE: a Testbed of Automatically Generated Invalid Questions to Evaluate Large Language Models for Hallucinations EMNLP 2023 Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena NeurIPS 2023 Mass-Producing Failures of Multimodal Systems with Language Models NeurIPS 2023 Navigating the Pitfalls of Active Learning Evaluation: A Systematic Framework for Meaningful Performance Assessment NeurIPS 2023 On using distribution-based compositionality assessment to evaluate compositional generalisation in machine translation EMNLP 2023