benchmark evaluation

Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data ACL 2024 Are We on the Right Way for Evaluating Large Vision-Language Models? NeurIPS 2024 Artifacts or Abduction: How Do LLMs Answer Multiple-Choice Questions Without the Question? ACL 2024 Assessing the Capabilities of Large Language Models in Coreference: An Evaluation COLING 2024 AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks? EMNLP 2024 A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models EMNLP 2024 AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models EMNLP 2024 Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models NeurIPS 2024 Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs NeurIPS 2024 BATS: BenchmArking Text Simplicity 🦇 ACL 2024 BEACON: Benchmark for Comprehensive RNA Tasks and Language Models NeurIPS 2024 ∞Bench: Extending Long Context Evaluation Beyond 100K Tokens ACL 2024 BenchIE^FL: A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark ACL 2024 Benchmarking and Improving Long-Text Translation with Large Language Models ACL 2024 Benchmarking Chinese Commonsense Reasoning of LLMs: From Chinese-Specifics to Reasoning-Memorization Correlations ACL 2024 Benchmarking Data Science Agents ACL 2024 Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming NeurIPS 2024 Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPT COLING 2024 Benchmarking Large Language Models in Retrieval-Augmented Generation AAAI 2024 Benchmarking Large Language Models on CFLUE - A Chinese Financial Language Understanding Evaluation Dataset ACL 2024 Benchmarking LLMs via Uncertainty Quantification NeurIPS 2024 Benchmarking Low-Resource Machine Translation Systems ACL 2024 Benchmarking PtO and PnO Methods in the Predictive Combinatorial Optimization Regime NeurIPS 2024 Benchmarking Retrieval-Augmented Generation for Medicine ACL 2024 Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks NeurIPS 2024