Evaluation

Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs EMNLP 2025 Fine-Tune on the Format: First Improving Multiple-Choice Evaluation for Intermediate LLM Checkpoints ACL 2025 FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025 Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025 FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks EMNLP 2025 FROC: Building Fair ROC from a Trained Classifier AAAI 2025 From Behavioral Performance to Internal Competence: Interpreting Vision-Language Models with VLM-Lens EMNLP 2025 From Parameters to Performance: A Data-Driven Study on LLM Structure and Development EMNLP 2025 From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models EMNLP 2025 FrontierScience Bench: Evaluating AI Research Capabilities in LLMs ACL 2025 Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objects CVPR 2025 Gender Inclusivity Fairness Index (GIFI): A Multilevel Framework for Evaluating Gender Diversity in Large Language Models ACL 2025 GuideBench: Benchmarking Domain-Oriented Guideline Following for LLM Agents ACL 2025 How Far are AI-generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approach ICCV 2025 How Not to Stitch Representations to Measure Similarity: Task Loss Matching Versus Direct Matching AAAI 2025 How Persuasive Is Your Context? EMNLP 2025 Hypergraph Attacks via Injecting Homogeneous Nodes into Elite Hyperedges AAAI 2025 IDEA-Bench: How Far are Generative Models from Professional Designing? CVPR 2025 Image Over Text: Transforming Formula Recognition Evaluation with Character Detection Matching CVPR 2025 Improving Accuracy and Calibration via Differentiated Deep Mutual Learning CVPR 2025 Improving Model Factuality with Fine-grained Critique-based Evaluator ACL 2025 InductionBench: LLMs Fail in the Simplest Complexity Class ACL 2025 Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025 JuStRank: Benchmarking LLM Judges for System Ranking ACL 2025 Language Model Probabilities are Not Calibrated in Numeric Contexts ACL 2025