benchmark evaluation

Can Large Language Models Understand Symbolic Graphics Programs? ICLR 2025 Can Large Language Models Win the International Mathematical Games? EMNLP 2025 Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure ACL 2025 Can LLMs Help Uncover Insights about LLMs? A Large-Scale, Evolving Literature Analysis of Frontier LLMs ACL 2025 Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environments EMNLP 2025 Can LLMs Identify Critical Limitations within Scientific Research? A Systematic Evaluation on AI Research Papers ACL 2025 Can LLMs Reason About Program Semantics? A Comprehensive Evaluation of LLMs on Formal Specification Inference ACL 2025 Can Multimodal Foundation Models Understand Schematic Diagrams? An Empirical Study on Information-Seeking QA over Scientific Papers ACL 2025 Can Multimodal Large Language Models Understand Spatial Relations? ACL 2025 Can Multimodal LLMs See Materials Clearly? A Multimodal Benchmark on Materials Characterization EMNLP 2025 Can’t See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs ACL 2025 Can We Trust AI Doctors? A Survey of Medical Hallucination in Large Language and Large Vision-Language Models ACL 2025 Can You Really Trust Code Copilot? Evaluating Large Language Models from a Code Security Perspective ACL 2025 Can you SPLICE it together? A Human Curated Benchmark for Probing Visual Reasoning in VLMs EMNLP 2025 CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era ACL 2025 CAPTURE: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting ICCV 2025 CausalGraph2LLM: Evaluating LLMs for Causal Queries NAACL 2025 CausalGraphBench: a Benchmark for Evaluating Language Models capabilities of Causal Graph discovery ACL 2025 CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Models EMNLP 2025 CBT-Bench: Evaluating Large Language Models on Assisting Cognitive Behavior Therapy NAACL 2025 CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models ACL 2025 CFBench: A Comprehensive Constraints-Following Benchmark for LLMs ACL 2025 ChameleonBench: Quantifying Alignment Faking in Large Language Models ACML 2025 CharacterBench: Benchmarking Character Customization of Large Language Models AAAI 2025 ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs’ Capability via Chart Editing ACL 2025