Evaluation

Q-Bench-Video: Benchmark the Video Quality Understanding of LMMs CVPR 2025 Rationales Are Not Silver Bullets: Measuring the Impact of Rationales on Model Performance and Reliability ACL 2025 RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks EMNLP 2025 RDI: An adversarial robustness evaluation metric for deep neural networks based on model statistical features UAI 2025 Reconsidering LLM Uncertainty Estimation Methods in the Wild ACL 2025 Redundancy Principles for MLLMs Benchmarks ACL 2025 RefVNLI: Towards Scalable Evaluation of Subject-driven Text-to-image Generation EMNLP 2025 REPA: Russian Error Types Annotation for Evaluating Text Generation and Judgment Capabilities ACL 2025 RESQUE: Quantifying Estimator to Task and Distribution Shift for Sustainable Model Reusability AAAI 2025 Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing EMNLP 2025 Revisiting LLM Value Probing Strategies: Are They Robust and Expressive? EMNLP 2025 REVIVING YOUR MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing EMNLP 2025 SCOP: Evaluating the Comprehension Process of Large Language Models from a Cognitive View ACL 2025 SDBench: A Comprehensive Benchmark Suite for Speaker Diarization Interspeech 2025 SEAL: Systematic Error Analysis for Value ALignment AAAI 2025 SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responses AAAI 2025 SFAL: Semantic-Functional Alignment Scores for Distributional Evaluation of Auto-Interpretability in Sparse Autoencoders EMNLP 2025 SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluation ACL 2025 Surface Fairness, Deep Bias: A Comparative Study of Bias in Language Models ACL 2025 TeXpert: A Multi-Level Benchmark for Evaluating LaTeX Code Generation by LLMs ACL 2025 The 2nd Automated Verification of Textual Claims (AVeriTeC) Shared Task: Open-weights, Reproducible and Efficient Systems ACL 2025 The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs EMNLP 2025 The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation ACL 2025 The UD-NewsCrawl Treebank: Reflections and Challenges from a Large-scale Tagalog Syntactic Annotation Project ACL 2025 Towards Early Prediction of Self-Supervised Speech Model Performance Interspeech 2025