model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

Deploying Tiny LVLM Judges for Real-World Evaluation of Chart Models: Lessons Learned and Best Practices EMNLP 2025

PCRI: Measuring Context Robustness in Multimodal Models for Enterprise Applications EMNLP 2025

DefVerify: Do Hate Speech Models Reflect Their Dataset’s Definition? COLING 2025

OpenNER 1.0: Standardized Open-Access Named Entity Recognition Datasets in 50+ Languages EMNLP 2025

SYNC: A Synthetic Long-Context Understanding Benchmark for Controlled Comparisons of Model Capabilities EMNLP 2025

Investigating How Pre-training Data Leakage Affects Models’ Reproduction and Detection Capabilities EMNLP 2025

ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editing ICCV 2025

Adversarial Robustness of Discriminative Self-Supervised Learning in Vision ICCV 2025

SeaExam and SeaBench: Benchmarking LLMs with Local Multilingual Questions in Southeast Asia NAACL 2025

Evaluation of Medical Large Language Models: Taxonomy, Review, and Directions IJCAI 2025

The Practical Impacts of Theoretical Constructs on Empathy Modeling EMNLP 2025

Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults EMNLP 2025

Do Large Language Models Align with Core Mental Health Counseling Competencies? NAACL 2025

Are Small Language Models Ready to Compete with Large Language Models for Practical Applications? NAACL 2025

Transitive self-consistency evaluation of NLI models without gold labels EMNLP 2025

Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language ACL 2025

What is an “Abstract Reasoner”? Revisiting Experiments and Arguments about Large Language Models ACL 2025

From Measurement to Mitigation: Exploring the Transferability of Debiasing Approaches to Gender Bias in Maltese Language Models ACL 2025

Towards Comprehensive Evaluation of Open-Source Language Models: A Multi-Dimensional, User-Driven Approach ACL 2025

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges ACL 2025

Ad-hoc Concept Forming in the Game Codenames as a Means for Evaluating Large Language Models ACL 2025

Evaluating Intermediate Reasoning of Code-Assisted Large Language Models for Mathematics ACL 2025

From Calculation to Adjudication: Examining LLM Judges on Mathematical Reasoning Tasks ACL 2025

skLEP: A Slovak General Language Understanding Benchmark ACL 2025

Graders Should Cheat: Privileged Information Enables Expert-Level Automated Evaluations EMNLP 2025