model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

SELF-[IN]CORRECT: LLMs Struggle with Discriminating Self-Generated Responses AAAI 2025

Maximizing Signal in Human-Model Preference Alignment AAAI 2025

Language-Models-as-a-Service: Overview of a New Paradigm and its Challenges AAAI 2025

ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025

Automated Model Evaluation for Object Detection via Prediction Consistency and Reliability ICCV 2025

Adversarial Robustness of Discriminative Self-Supervised Learning in Vision ICCV 2025

Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models ACL 2025

Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language ACL 2025

Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs EMNLP 2025

What is an “Abstract Reasoner”? Revisiting Experiments and Arguments about Large Language Models ACL 2025

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA ACL 2025

From Measurement to Mitigation: Exploring the Transferability of Debiasing Approaches to Gender Bias in Maltese Language Models ACL 2025

AdamMeme: Adaptively Probe the Reasoning Capacity of Multimodal Large Language Models on Harmfulness ACL 2025

Towards Comprehensive Evaluation of Open-Source Language Models: A Multi-Dimensional, User-Driven Approach ACL 2025

The Stochastic Parrot on LLM’s Shoulder: A Summative Assessment of Physical Concept Understanding NAACL 2025

Style Over Substance: Evaluation Biases for Large Language Models COLING 2025

CAST: Cross-modal Alignment Similarity Test for Vision Language Models COLING 2025

Cognitive Biases, Task Complexity, and Result Interpretability in Large Language Models COLING 2025

DefVerify: Do Hate Speech Models Reflect Their Dataset’s Definition? COLING 2025

ODP-Bench: Benchmarking Out-of-Distribution Performance Prediction ICCV 2025

Evaluating Intermediate Reasoning of Code-Assisted Large Language Models for Mathematics ACL 2025

From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks ACL 2025

The Alternative Annotator Test for LLM-as-a-Judge: How to Statistically Justify Replacing Human Annotators with LLMs ACL 2025

skLEP: A Slovak General Language Understanding Benchmark ACL 2025

A Comprehensive Evaluation of Large Language Models for Retrieval-Augmented Generation under Noisy Conditions IJCNLP 2025