evaluation benchmark

JudgeLM: Fine-tuned Large Language Models are Scalable Judges ICLR 2025 Judging the Judges: Can Large Vision-Language Models Fairly Evaluate Chart Comprehension and Reasoning? ACL 2025 Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025 Large Language Models Often Say One Thing and Do Another ICLR 2025 LIFBench: Evaluating the Instruction Following Performance and Stability of Large Language Models in Long-Context Scenarios ACL 2025 LiveBench: A Challenging, Contamination-Limited LLM Benchmark ICLR 2025 LLM The Genius Paradox: A Linguistic and Math Expert’s Struggle with Simple Word-based Counting Problems NAACL 2025 LMUNIT: Fine-grained Evaluation with Natural Language Unit Tests EMNLP 2025 Long-Form Information Alignment Evaluation Beyond Atomic Facts EMNLP 2025 LongLeader: A Comprehensive Leaderboard for Large Language Models in Long-context Scenarios NAACL 2025 LOTUS: A Leaderboard for Detailed Image Captioning from Quality to Societal Bias and User Preferences ACL 2025 M2RC-EVAL: Massively Multilingual Repository-level Code Completion Evaluation ACL 2025 MaXIFE: Multilingual and Cross-lingual Instruction Following Evaluation ACL 2025 MDBench: A Synthetic Multi-Document Reasoning Benchmark Generated with Knowledge Guidance ACL 2025 MDIT-Bench: Evaluating the Dual-Implicit Toxicity in Large Multimodal Models ACL 2025 MedEBench: Diagnosing Reliability in Text-Guided Medical Image Editing EMNLP 2025 MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics NAACL 2025 MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark ACL 2025 MQuAKE-Remastered: Multi-Hop Knowledge Editing Can Only Be Advanced with Reliable Evaluations ICLR 2025 MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs ACL 2025 MUSE: Machine Unlearning Six-Way Evaluation for Language Models ICLR 2025 Navigating the Political Compass: Evaluating Multilingual LLMs across Languages and Nationalities ACL 2025 ODE: Open-Set Evaluation of Hallucinations in Multimodal Large Language Models CVPR 2025 OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation CVPR 2025 PCRI: Measuring Context Robustness in Multimodal Models for Enterprise Applications EMNLP 2025