benchmark evaluation

1539 papers

Explore in graph

Also known as

MT-BENCH BDC

Co-occurring keywords

large language model (12755) question answering (2904) multimodal learning (4622) language model (4573) multimodal large language model (865) vision-language model (2235) visual question answering (1000) evaluation benchmark (250) multilingual nlp (1423) benchmark dataset (619)

Papers

Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation? NIPS 2024

Are We on the Right Way for Evaluating Large Vision-Language Models? NIPS 2024

StackEval: Benchmarking LLMs in Coding Assistance NIPS 2024

Two Issues with Chinese Spelling Correction and A Refinement Solution ACL 2024

Beyond Aesthetics: Cultural Competence in Text-to-Image Models NIPS 2024

BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices NIPS 2024

Efficient multi-prompt evaluation of LLMs NIPS 2024

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content NIPS 2024

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models NIPS 2024

GameTraversalBenchmark: Evaluating Planning Abilities Of Large Language Models Through Traversing 2D Game Maps NIPS 2024

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs NIPS 2024

A Benchmark Suite for Evaluating Neural Mutual Information Estimators on Unstructured Datasets NIPS 2024

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments NIPS 2024

EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations NIPS 2024

A Cross-Domain Benchmark for Active Learning NIPS 2024

Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? NIPS 2024

On the Worst Prompt Performance of Large Language Models NIPS 2024

VideoGUI: A Benchmark for GUI Automation from Instructional Videos NIPS 2024

A Large-Scale Human-Centric Benchmark for Referring Expression Comprehension in the LMM Era NIPS 2024

Efficient Lifelong Model Evaluation in an Era of Rapid Progress NIPS 2024

Animal-Bench: Benchmarking Multimodal Video Models for Animal-centric Video Understanding NIPS 2024

SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents NIPS 2024

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NIPS 2024

MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding NIPS 2024

MAmmoTH2: Scaling Instructions from the Web NIPS 2024