model evaluation

FlagEvalMM: A Flexible Framework for Comprehensive Multimodal Model Evaluation ACL 2025 From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks ACL 2025 From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge EMNLP 2025 From Measurement to Mitigation: Exploring the Transferability of Debiasing Approaches to Gender Bias in Maltese Language Models ACL 2025 GPT-4 is Judged More Human than Humans in Displaced and Inverted Turing Tests COLING 2025 Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025 Harry Potter is Still Here! Probing Knowledge Leakage in Targeted Unlearned Large Language Models EMNLP 2025 Has the Deep Neural Network learned the Stochastic Process? An Evaluation Viewpoint ICLR 2025 Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning ICCV 2025 Human-AI Collaboration: How AIs Augment Human Teammates ACL 2025 ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025 Identifying Unlearned Data in LLMs via Membership Inference Attacks EMNLP 2025 InterFeedback: Unveiling Interactive Intelligence of Large Multimodal Models with Human Feedback EMNLP 2025 Investigating How Pre-training Data Leakage Affects Models’ Reproduction and Detection Capabilities EMNLP 2025 Is Your Video Language Model a Reliable Judge? ICLR 2025 Jailbreak Distillation: Renewable Safety Benchmarking EMNLP 2025 JudgeBench: A Benchmark for Evaluating LLM-Based Judges ICLR 2025 Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 JuStRank: Benchmarking LLM Judges for System Ranking ACL 2025 Just Trial Once: Ongoing Causal Validation of Machine Learning Models UAI 2025 Language Model Probabilities are Not Calibrated in Numeric Contexts ACL 2025 Language-Models-as-a-Service: Overview of a New Paradigm and its Challenges AAAI 2025 Large Language Model Evaluation via Matrix Nuclear-Norm EMNLP 2025 Less Can be More: An Empirical Evaluation of Small and Large Language Models for Sentence-level Claim Detection ACL 2025