benchmark evaluation

SysBench: Can LLMs Follow System Message? ICLR 2025 T2R-BENCH: A Benchmark for Real World Table-to-Report Task EMNLP 2025 T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generation CVPR 2025 TableBench: A Comprehensive and Complex Benchmark for Table Question Answering AAAI 2025 TactfulToM: Do LLMs have the Theory of Mind ability to understand White Lies? EMNLP 2025 TaxoAlign: Scholarly Taxonomy Generation Using Language Models EMNLP 2025 TC-Bench: Benchmarking Temporal Compositionality in Conditional Video Generation ACL 2025 TCP: a Benchmark for Temporal Constraint-Based Planning EMNLP 2025 TelAgentBench: A Multi-faceted Benchmark for Evaluating LLM-based Agents in Telecommunications EMNLP 2025 TeluguST-46: A Benchmark Corpus and Comprehensive Evaluation for Telugu-English Speech Translation IJCNLP 2025 Temporal Referential Consistency: Do LLMs Favor Sequences Over Absolute Time References? EMNLP 2025 Testing the Boundaries of LLMs: Dialectal and Language-Variety Tasks COLING 2025 TeXpert: A Multi-Level Benchmark for Evaluating LaTeX Code Generation by LLMs ACL 2025 Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Text EMNLP 2025 Text2World: Benchmarking Large Language Models for Symbolic World Model Generation ACL 2025 ThaiOCRBench: A Task-Diverse Benchmark for Vision-Language Understanding in Thai IJCNLP 2025 The 2nd Automated Verification of Textual Claims (AVeriTeC) Shared Task: Open-weights, Reproducible and Efficient Systems ACL 2025 The 3D-PC: a benchmark for visual perspective taking in humans and machines ICLR 2025 The Essence of Contextual Understanding in Theory of Mind: A Study on Question Answering with Story Characters ACL 2025 The Interspeech 2025 Challenge on Speech Emotion Recognition in Naturalistic Conditions Interspeech 2025 Theory of Mind in Large Language Models: Assessment and Enhancement ACL 2025 The Russian-focused embedders’ exploration: ruMTEB benchmark and Russian embedding model design NAACL 2025 The Visual Counter Turing Test (VCT²): A Benchmark for Evaluating AI-Generated Image Detection and the Visual AI Index (V_AI) IJCNLP 2025 Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts ACL 2025 TLUE: A Tibetan Language Understanding Evaluation Benchmark EMNLP 2025