← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models ACL 2024
InFoBench: Evaluating Instruction Following Ability in Large Language Models ACL 2024
OOP: Object-Oriented Programming Evaluation Benchmark for Large Language Models ACL 2024
BloomVQA: Assessing Hierarchical Multi-modal Comprehension ACL 2024
TAXI: Evaluating Categorical Knowledge Editing for Language Models ACL 2024
Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective ACL 2024
Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024
BenchIE^FL: A Manually Re-Annotated Fact-Based Open Information Extraction Benchmark ACL 2024
Navigating the Maze of Explainable AI: A Systematic Approach to Evaluating Methods and Metrics NIPS 2024
Benchmarking Generative Models on Computational Thinking Tests in Elementary Visual Programming NIPS 2024
GPT-Fathom: Benchmarking Large Language Models to Decipher the Evolutionary Path towards GPT-4 and Beyond NAACL 2024
JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images NIPS 2024
CausalBench: A Comprehensive Benchmark for Evaluating Causal Reasoning Capabilities of Large Language Models ACL 2024
TelBench: A Benchmark for Evaluating Telco-Specific Large Language Models EMNLP 2024
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs’ Pragmatics Capabilities ACL 2024
The State of the Art of Large Language Models on Chartered Financial Analyst Exams EMNLP 2024
AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension ACL 2024
Disordered-DABS: A Benchmark for Dynamic Aspect-Based Summarization in Disordered Texts EMNLP 2024
BEACON: Benchmark for Comprehensive RNA Tasks and Language Models NIPS 2024
An Open-Source Data Contamination Report for Large Language Models EMNLP 2024
MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems EMNLP 2024
LongGenBench: Long-context Generation Benchmark EMNLP 2024
SpeciaLex: A Benchmark for In-Context Specialized Lexicon Learning EMNLP 2024
$\texttt{causalAssembly}$: Generating Realistic Production Data for Benchmarking Causal Discovery CLEAR 2024
AC-EVAL: Evaluating Ancient Chinese Language Understanding in Large Language Models EMNLP 2024