model evaluation

Towards Robust Comparisons of NLP Models: A Case Study COLING 2025 TP-Eval: Tap Multimodal LLMs' Potential in Evaluation by Customizing Prompts IJCAI 2025 Transitive self-consistency evaluation of NLI models without gold labels EMNLP 2025 TRUSTEVAL: A Dynamic Evaluation Toolkit on Trustworthiness of Generative Foundation Models NAACL 2025 Unearthing Skill-level Insights for Understanding Trade-offs of Foundation Models ICLR 2025 UniCBE: An Uniformity-driven Comparing Based Evaluation Framework with Unified Multi-Objective Optimization ICLR 2025 Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models ACL 2025 UPME: An Unsupervised Peer Review Framework for Multimodal Large Language Model Evaluation CVPR 2025 VibeCheck: Discover and Quantify Qualitative Differences in Large Language Models ICLR 2025 VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration ACL 2025 When Benchmarks Talk: Re-Evaluating Code LLMs with Interactive Feedback ACL 2025 Where is this coming from? Making groundedness count in the evaluation of Document VQA models NAACL 2025 Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA ACL 2025 YESciEval: Robust LLM-as-a-Judge for Scientific Question Answering ACL 2025 Zero-cost Proxy for Adversarial Robustness Evaluation ICLR 2025 Adaptive Labeling for Efficient Out-of-distribution Model Evaluation NeurIPS 2024 A Data-Centric Perspective on Evaluating Machine Learning Models for Tabular Data NeurIPS 2024 Aequitas Flow: Streamlining Fair ML Experimentation JMLR 2024 AlignBench: Benchmarking Chinese Alignment of Large Language Models ACL 2024 A linguistically-motivated evaluation methodology for unraveling model’s abilities in reading comprehension tasks EMNLP 2024 A Multilevel Analysis of PubMed-only BERT-based Biomedical Models NAACL 2024 Analyzing Occupational Distribution Representation in Japanese Language Models COLING 2024 Analyzing the Understanding of Morphologically Complex Words in Large Language Models COLING 2024 Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification AAAI 2024 Are Large Language Models Consistent over Value-laden Questions? EMNLP 2024