← Keywords

benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Constructing Domain-Specific Evaluation Sets for LLM-as-a-judge EMNLP 2024
Benchmarking Low-Resource Machine Translation Systems ACL 2024
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents ACL 2024
CMMLU: Measuring massive multitask language understanding in Chinese ACL 2024
On the Evaluation of Speech Foundation Models for Spoken Language Understanding ACL 2024
Prompting open-source and commercial language models for grammatical error correction of English learner text ACL 2024
HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits ACL 2024
EconNLI: Evaluating Large Language Models on Economics Reasoning ACL 2024
BATS: BenchmArking Text Simplicity 🦇 ACL 2024
Star-Agents: Automatic Data Optimization with LLM Agents for Instruction Tuning NIPS 2024
WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks NIPS 2024
VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark NIPS 2024
Benchmarking LLMs via Uncertainty Quantification NIPS 2024
Evaluating Large Vision-and-Language Models on Children's Mathematical Olympiads NIPS 2024
ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs NIPS 2024
GTBench: Uncovering the Strategic Reasoning Capabilities of LLMs via Game-Theoretic Evaluations NIPS 2024
DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models EMNLP 2024
AutoDetect: Towards a Unified Framework for Automated Weakness Detection in Large Language Models EMNLP 2024
ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos NIPS 2024
CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models EMNLP 2024
CONSTRUCTURE: Benchmarking CONcept STRUCTUre REasoning for Multimodal Large Language Models EMNLP 2024
IntentionQA: A Benchmark for Evaluating Purchase Intention Comprehension Abilities of Language Models in E-commerce EMNLP 2024
MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMs NIPS 2024
Micro-Bench: A Microscopy Benchmark for Vision-Language Understanding NIPS 2024
E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding NIPS 2024