benchmark dataset

Development of Numerical Error Detection Tasks to Analyze the Numerical Capabilities of Language Models COLING 2025 DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management EMNLP 2025 Do Current Video LLMs Have Strong OCR Abilities? A Preliminary Study COLING 2025 Does Your Vision-Language Model Get Lost in the Long Video Sampling Dilemma? ICCV 2025 Dolphin: Moving Towards Closed-loop Auto-research through Thinking, Practice, and Feedback ACL 2025 Doppelganger-JC: Benchmarking the LLMs’ Understanding of Cross-Lingual Homographs between Japanese and Chinese IJCNLP 2025 Drivel-ology: Challenging LLMs with Interpreting Nonsense with Depth EMNLP 2025 DynamicNER: A Dynamic, Multilingual, and Fine-Grained Dataset for LLM-based Named Entity Recognition EMNLP 2025 EditInspector: A Benchmark for Evaluation of Text-Guided Image Edits ACL 2025 EgoPoints: Advancing Point Tracking for Egocentric Videos WACV 2025 EmoBench-UA: A Benchmark Dataset for Emotion Detection in Ukrainian EMNLP 2025 Evaluating Image Hallucination in Text-to-Image Generation with Question-Answering AAAI 2025 Evaluating Speech Enhancement Performance Across Demographics and Language Interspeech 2025 Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish ACL 2025 Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration ACL 2025 Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning ACL 2025 FACT5: A Novel Benchmark and Pipeline for Nuanced Fact-Checking of Complex Statements ACL 2025 Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation NAACL 2025 Factual Knowledge in Language Models: Robustness and Anomalies under Simple Temporal Context Variations ACL 2025 FaiST: A Benchmark Dataset for Fairness in Speech Technology Interspeech 2025 Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs EMNLP 2025 FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025 FinNLI: Novel Dataset for Multi-Genre Financial Natural Language Inference Benchmarking NAACL 2025 FOCUS: A Benchmark for Targeted Socratic Question Generation via Source-Span Grounding IJCNLP 2025 Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models CVPR 2025