Evaluation

BIG-Bench Extra Hard ACL 2025 ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs’ Capability via Chart Editing ACL 2025 CLEME2.0: Towards Interpretable Evaluation by Disentangling Edits for Grammatical Error Correction ACL 2025 CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models ACL 2025 ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities ACL 2025 Contra4: Evaluating Contrastive Cross-Modal Reasoning in Audio, Video, Image, and 3D EMNLP 2025 CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025 Crowd Comparative Reasoning: Unlocking Comprehensive Evaluations for LLM-as-a-Judge ACL 2025 Data Descriptions from Large Language Models with Influence Estimation EMNLP 2025 Data Laundering: Artificially Boosting Benchmark Results through Knowledge Distillation ACL 2025 DCR: Quantifying Data Contamination in LLMs Evaluation EMNLP 2025 DepthCues: Evaluating Monocular Depth Perception in Large Vision Models CVPR 2025 Don’t Take the Premise for Granted: Evaluating the Premise Critique Ability of Large Language Models EMNLP 2025 Dynamic Evaluation for Oversensitivity in LLMs EMNLP 2025 EditInspector: A Benchmark for Evaluation of Text-Guided Image Edits ACL 2025 EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models EMNLP 2025 Enabling the replicability of speech synthesis perceptual evaluations Interspeech 2025 Evaluating Deep Speaker Embedding Robustness to Domain, Sampling Rate, and Codec Variations Interspeech 2025 Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish ACL 2025 Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration ACL 2025 EvolveBench: A Comprehensive Benchmark for Assessing Temporal Awareness in LLMs on Evolving Knowledge ACL 2025 EXECUTE: A Multilingual Benchmark for LLM Token Understanding ACL 2025 Exploring Activation Patterns of Parameters in Language Models AAAI 2025 Exploring task formulation strategies to evaluate the coherence of classroom discussions with GPT-4o ACL 2025 FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models ACL 2025