evaluation benchmark

Curse of Knowledge: Your Guidance and Provided Knowledge are biasing LLM Judges in Complex Evaluation EMNLP 2025 DHP Benchmark: Are LLMs Good NLG Evaluators? NAACL 2025 Disentangling Language and Culture for Evaluating Multilingual Large Language Models ACL 2025 Does GPT Really Get It? A Hierarchical Scale to Quantify Human and AI’s Understanding of Algorithms AAAI 2025 Do LLMs Behave as Claimed? Investigating How LLMs Follow Their Own Claims using Counterfactual Questions EMNLP 2025 EditBoard: Towards a Comprehensive Evaluation Benchmark for Text-Based Video Editing Models AAAI 2025 ELAB: Extensive LLM Alignment Benchmark in Persian Language ACL 2025 ETHIC: Evaluating Large Language Models on Long-Context Tasks with High Information Coverage NAACL 2025 ETVA: Evaluation of Text-to-Video Alignment via Fine-grained Question Generation and Answering ICCV 2025 Evaluating Step-by-step Reasoning Traces: A Survey EMNLP 2025 Evaluating the Evaluator: Measuring LLMs’ Adherence to Task Evaluation Instructions AAAI 2025 ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models ACL 2025 Find the Intention of Instruction: Comprehensive Evaluation of Instruction Understanding for Large Language Models NAACL 2025 Flaw or Artifact? Rethinking Prompt Sensitivity in Evaluating LLMs EMNLP 2025 From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models EMNLP 2025 HalluLens: LLM Hallucination Benchmark ACL 2025 Hard Emotion Test Evaluation Sets for Language Models NAACL 2025 HuGME: A benchmark system for evaluating Hungarian generative LLMs ACL 2025 ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025 IDEA-Bench: How Far are Generative Models from Professional Designing? CVPR 2025 IFEval-Audio: Benchmarking Instruction-Following Capability in Audio-based Large Language Models IJCNLP 2025 Incorporating Diverse Perspectives in Cultural Alignment: Survey of Evaluation Benchmarks Through A Three-Dimensional Framework EMNLP 2025 INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurance ICCV 2025 IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization ACL 2025 Is Your LLM Outdated? A Deep Look at Temporal Generalization NAACL 2025