Evaluation

F²Bench: An Open-ended Fairness Evaluation Benchmark for LLMs with Factuality Considerations EMNLP 2025 FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation ACL 2025 Factual Knowledge in Language Models: Robustness and Anomalies under Simple Temporal Context Variations ACL 2025 Failure Cases Are Better Learned But Boundary Says Sorry: Facilitating Smooth Perception Change for Accuracy-Robustness Trade-Off in Adversarial Training ICCV 2025 Familiarity: Better Evaluation of Zero-Shot Named Entity Recognition by Quantifying Label Shifts in Synthetic Training Data NAACL 2025 FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs’ Responsiveness to Human Feedback EMNLP 2025 Feeding Two Birds or Favoring One? Adequacy–Fluency Tradeoffs in Evaluation and Meta-Evaluation of Machine Translation EMNLP 2025 Few-Shot Prompting, Full-Scale Confusion: Evaluating Large Language Models for Humor Detection in Croatian Tweets ACL 2025 Finance Language Model Evaluation (FLaME) ACL 2025 Findings of the BEA 2025 Shared Task on Pedagogical Ability Assessment of AI-powered Tutors ACL 2025 Findings of the IWSLT 2025 Evaluation Campaign ACL 2025 Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets EMNLP 2025 Findings of the WMT25 Multilingual Instruction Shared Task: Persistent Hurdles in Reasoning, Generation, and Evaluation EMNLP 2025 Findings of the WMT25 Shared Task on Automated Translation Evaluation Systems: Linguistic Diversity is Challenging and References Still Help EMNLP 2025 Fine-Grained Evaluation of English-Russian MT in 2025: Linguistic Challenges Mirroring Human Translator Training EMNLP 2025 FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation ACL 2025 FinNLP-FNP-LLMFinLegal-2025 Shared Task: Financial Misinformation Detection Challenge Task COLING 2025 FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation ACL 2025 Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025 FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models NAACL 2025 Forensics-Bench: A Comprehensive Forgery Detection Benchmark Suite for Large Vision Language Models CVPR 2025 Forget What You Know about LLMs Evaluations - LLMs are Like a Chameleon EMNLP 2025 FQ-Eval: Building Evaluation Dataset for User-centered Follow-up Question Generation EMNLP 2025 Frame by Familiar Frame: Understanding Replication in Video Diffusion Models WACV 2025 From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks ACL 2025