Evaluation

Towards Harmonized Uncertainty Estimation for Large Language Models ACL 2025 Towards Precise Prediction Uncertainty in GNNs: Refining GNNs with Topology-grouping Strategy AAAI 2025 Training on the Benchmark Is Not All You Need AAAI 2025 TripleFact: Defending Data Contamination in the Evaluation of LLM-driven Fake News Detection ACL 2025 TUNA: Comprehensive Fine-grained Temporal Understanding Evaluation on Dense Dynamic Videos ACL 2025 Two Steps from Hell: Compositionality on Chemical LMs EMNLP 2025 U-MATH: A University-Level Benchmark for Evaluating Mathematical Skills in Large Language Models ACL 2025 Unanswerability Evaluation for Retrieval Augmented Generation ACL 2025 UNCLE: Benchmarking Uncertainty Expressions in Long-Form Generation EMNLP 2025 Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models ACL 2025 UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation CVPR 2025 VideoAutoArena: An Automated Arena for Evaluating Large Multimodal Models in Video Analysis through User Simulation CVPR 2025 VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration ACL 2025 Waste-Bench: A Comprehensive Benchmark for Evaluating VLLMs in Cluttered Environments EMNLP 2025 Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Models ACL 2025 “What do you call a dog that is incontrovertibly true? Dogma”: Testing LLM Generalization through Humor ACL 2025 When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification ACL 2025 When the LM misunderstood the human chuckled: Analyzing garden path effects in humans and language models ACL 2025 Where Are We? Evaluating LLM Performance on African Languages ACL 2025 Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025 WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025 ABCFair: an Adaptable Benchmark approach for Comparing Fairness Methods NeurIPS 2024 Accelerating Adversarially Robust Model Selection for Deep Neural Networks via Racing AAAI 2024 Annotation alignment: Comparing LLM and human annotations of conversational safety EMNLP 2024 A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners EMNLP 2024