Evaluation

Can Large Language Models Win the International Mathematical Games? EMNLP 2025 Can LLMs Detect Intrinsic Hallucinations in Paraphrasing and Machine Translation? ACL 2025 Can LLMs Express Personality Across Cultures? Introducing CulturalPersonas for Evaluating Trait Alignment EMNLP 2025 Can LLMs Extract Frame-Semantic Arguments? EMNLP 2025 Can LLMs Generate and Solve Linguistic Olympiad Puzzles? EMNLP 2025 Can LLMs Generate High-Quality Test Cases for Algorithm Problems? TestCase-Eval: A Systematic Evaluation of Fault Coverage and Exposure ACL 2025 Can LLMs Help You at Work? A Sandbox for Evaluating LLM Agents in Enterprise Environments EMNLP 2025 Can LLMs Identify Critical Limitations within Scientific Research? A Systematic Evaluation on AI Research Papers ACL 2025 Can LLMs Narrate Tabular Data? An Evaluation Framework for Natural Language Representations of Text-to-SQL System Outputs EMNLP 2025 Can LLMs Rank the Harmfulness of Smaller LLMs? We are Not There Yet ACL 2025 Can LLMs Reason Abstractly Over Math Word Problems Without CoT? Disentangling Abstract Formulation From Arithmetic Computation EMNLP 2025 Can LLMs Reliably Simulate Real Students’ Abilities in Mathematics and Reading Comprehension? ACL 2025 Can LLMs simulate the same correct solutions to free-response math problems as real students? EMNLP 2025 Can Third Parties Read Our Emotions? ACL 2025 Can’t See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs ACL 2025 Can We Trust Machine Learning? The Reliability of Features from Open-Source Speech Analysis Tools for Speech Modeling Interspeech 2025 CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era ACL 2025 CAPTURE: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting ICCV 2025 CCHall: A Novel Benchmark for Joint Cross-Lingual and Cross-Modal Hallucinations Detection in Large Language Models ACL 2025 ChatBench: From Static Benchmarks to Human-AI Evaluation ACL 2025 CHATTER: A character-attribution dataset for narrative understanding NAACL 2025 CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists EMNLP 2025 Cherry-Picking in Time Series Forecasting: How to Select Datasets to Make Your Model Shine AAAI 2025 Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models ACL 2025 Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models ACL 2025