benchmark evaluation

Evaluating Multilingual Long-Context Models for Retrieval and Reasoning EMNLP 2024 Evaluating Numerical Reasoning in Text-to-Image Models NeurIPS 2024 Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ ACL 2024 EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations NeurIPS 2024 Examining the robustness of LLM evaluation to the distributional assumptions of benchmarks ACL 2024 Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs CVPR 2024 Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers EMNLP 2024 FLORES+ Translation and Machine Translation Evaluation for the Erzya Language EMNLP 2024 FOFO: A Benchmark to Evaluate LLMs’ Format-Following Capability ACL 2024 FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models ACL 2024 FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in LLMs EMNLP 2024 From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models EMNLP 2024 Fundamental Capabilities of Large Language Models and their Applications in Domain Scenarios: A Survey ACL 2024 GameTraversalBenchmark: Evaluating Planning Abilities Of Large Language Models Through Traversing 2D Game Maps NeurIPS 2024 GC-Bench: An Open and Unified Benchmark for Graph Condensation NeurIPS 2024 Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models ACL 2024 GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solving ACL 2024 GeSS: Benchmarking Geometric Deep Learning under Scientific Applications with Distribution Shifts NeurIPS 2024 GLBench: A Comprehensive Benchmark for Graph with Large Language Models NeurIPS 2024 GlitchBench: Can Large Multimodal Models Detect Video Game Glitches? CVPR 2024 GMAI-MMBench: A Comprehensive Multimodal Evaluation Benchmark Towards General Medical AI NeurIPS 2024 GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond NAACL 2024 GRASP: A Novel Benchmark for Evaluating Language GRounding and Situated Physics Understanding in Multimodal Language Models IJCAI 2024 GTA: A Benchmark for General Tool Agents NeurIPS 2024 GTBench: Uncovering the Strategic Reasoning Capabilities of LLMs via Game-Theoretic Evaluations NeurIPS 2024