benchmark evaluation

Do Large Language Models Know Folktales? A Case Study of Yokai in Japanese Folktales ACL 2025 Do Large Language Models Truly Understand Geometric Structures? ICLR 2025 DOMAINEVAL: An Auto-Constructed Benchmark for Multi-Domain Code Generation AAAI 2025 Do not Abstain! Identify and Solve the Uncertainty ACL 2025 Don’t Take the Premise for Granted: Evaluating the Premise Critique Ability of Large Language Models EMNLP 2025 Doppelganger-JC: Benchmarking the LLMs’ Understanding of Cross-Lingual Homographs between Japanese and Chinese IJCNLP 2025 Do RAG Systems Really Suffer From Positional Bias? EMNLP 2025 DOVE: A Large-Scale Multi-Dimensional Predictions Dataset Towards Meaningful LLM Evaluation ACL 2025 Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation ACL 2025 Do You Know About My Nation? Investigating Multilingual Language Models’ Cultural Literacy Through Factual Knowledge EMNLP 2025 DreamBench++: A Human-Aligned Benchmark for Personalized Image Generation ICLR 2025 DSBench: How Far Are Data Science Agents from Becoming Data Science Experts? ICLR 2025 DyePack: Provably Flagging Test Set Contamination in LLMs Using Backdoors EMNLP 2025 DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation ACL 2025 Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language Bootstrapping ICLR 2025 Dynamic-SUPERB Phase-2: A Collaboratively Expanding Benchmark for Measuring the Capabilities of Spoken Language Models with 180 Tasks ICLR 2025 ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark CVPR 2025 ECom-Bench: Can LLM Agent Resolve Real-World E-commerce Customer Support Issues? EMNLP 2025 EditInspector: A Benchmark for Evaluation of Text-Guided Image Edits ACL 2025 EducationQ: Evaluating LLMs’ Teaching Capabilities Through Multi-Agent Dialogue Framework ACL 2025 EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understanding EMNLP 2025 EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Models EMNLP 2025 ELAB: Extensive LLM Alignment Benchmark in Persian Language ACL 2025 ELBA-Bench: An Efficient Learning Backdoor Attacks Benchmark for Large Language Models ACL 2025 ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models COLING 2025