benchmark evaluation

VideoGUI: A Benchmark for GUI Automation from Instructional Videos NeurIPS 2024 VisDiaHalBench: A Visual Dialogue Benchmark For Diagnosing Hallucination in Large Vision-Language Models ACL 2024 Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning ACL 2024 Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models NeurIPS 2024 VLKEB: A Large Vision-Language Model Knowledge Editing Benchmark NeurIPS 2024 V-PETL Bench: A Unified Visual Parameter-Efficient Transfer Learning Benchmark NeurIPS 2024 Vygotsky Distance: Measure for Benchmark Task Similarity COLING 2024 WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models ACL 2024 Weak-eval-Strong: Evaluating and Eliciting Lateral Thinking of LLMs with Situation Puzzles NeurIPS 2024 WenMind: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Classical Literature and Language Arts NeurIPS 2024 What Are the Odds? Language Models Are Capable of Probabilistic Reasoning EMNLP 2024 What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases NAACL 2024 When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards ACL 2024 When Reasoning Meets Information Aggregation: A Case Study with Sports Narratives EMNLP 2024 WhodunitBench: Evaluating Large Multimodal Agents via Murder Mystery Games NeurIPS 2024 Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2) NeurIPS 2024 WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia NeurIPS 2024 Wikimedia data for AI: a review of Wikimedia datasets for NLP tasks and AI-assisted editing EMNLP 2024 WildVision: Evaluating Vision-Language Models in the Wild with Human Preferences NeurIPS 2024 WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks NeurIPS 2024 Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation AAAI 2024 90% F1 Score in Relation Triple Extraction: Is it Real? EMNLP 2023 ACES: Translation Accuracy Challenge Sets at WMT 2023 EMNLP 2023 A Comprehensive Benchmark for Neural Human Radiance Fields NeurIPS 2023 A critical look at the evaluation of GNNs under heterophily: Are we really making progress? ICLR 2023