benchmark evaluation

RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysis ACL 2025 REAL-MM-RAG: A Real-World Multi-Modal Retrieval Benchmark ACL 2025 Reasoning is All You Need for Video Generalization: A Counterfactual Benchmark with Sub-question Evaluation ACL 2025 Reasoning or Memorization? Investigating LLMs’ Capability in Restoring Chinese Internet Homophones ACL 2025 ReasoningWeekly: A General Knowledge and Verbal Reasoning Challenge for Large Language Models IJCNLP 2025 Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems? IJCNLP 2025 Redundancy Principles for MLLMs Benchmarks ACL 2025 Reefknot: A Comprehensive Benchmark for Relation Hallucination Evaluation, Analysis and Mitigation in Multimodal Large Language Models ACL 2025 Ref-Long: Benchmarking the Long-context Referencing Capability of Long-context Language Models ACL 2025 REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research? ACL 2025 Rethinking NLP for Chemistry: A Critical Look at the USPTO Benchmark EMNLP 2025 Rethinking Prompt-based Debiasing in Large Language Model ACL 2025 Rethinking Reward Model Evaluation Through the Lens of Reward Overoptimization ACL 2025 Rethinking Text-based Protein Understanding: Retrieval or LLM? EMNLP 2025 Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models ACL 2025 Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing EMNLP 2025 Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can’t Answer? NAACL 2025 Revisiting 3D LLM Benchmarks: Are We Really Testing 3D Capabilities? ACL 2025 Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability ACL 2025 Revitalizing Saturated Benchmarks: A Weighted Metric Approach for Differentiating Large Language Model Performance NAACL 2025 RewardBench: Evaluating Reward Models for Language Modeling NAACL 2025 RLHF Algorithms Ranked: An Extensive Evaluation Across Diverse Tasks, Rewards, and Hyperparameters EMNLP 2025 RLMEval: Evaluating Research-Level Neural Theorem Proving EMNLP 2025 RMB: Comprehensively benchmarking reward models in LLM alignment ICLR 2025 RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style ICLR 2025