model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling Perspective ACL 2024

Evaluating Large Language Models for Health-related Queries with Presuppositions ACL 2024

AlignBench: Benchmarking Chinese Alignment of Large Language Models ACL 2024

Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation ACL 2024

Assessing “Implicit” Retrieval Robustness of Large Language Models EMNLP 2024

GAOKAO-MM: A Chinese Human-Level Benchmark for Multimodal Models Evaluation ACL 2024

Evaluating Gender Bias in Multilingual Multimodal AI Models: Insights from an Indian Context ACL 2024

GPTEval: A Survey on Assessments of ChatGPT and GPT-4 COLING 2024

On the Relationship between Truth and Political Bias in Language Models EMNLP 2024

I2EBench: A Comprehensive Benchmark for Instruction-based Image Editing NIPS 2024

Towards Automated Evaluation of Knowledge Encoded in Large Language Models COLING 2024

Exploratory Study on the Impact of English Bias of Generative Large Language Models in Dutch and French COLING 2024

Assessing Image-Captioning Models: A Novel Framework Integrating Statistical Analysis and Metric Patterns COLING 2024

Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models (LLMs) COLING 2024

What Factors Influence LLMs’ Judgments? A Case Study on Question Answering COLING 2024

Pre-Trained Language Models Represent Some Geographic Populations Better than Others COLING 2024

Analyzing the Understanding of Morphologically Complex Words in Large Language Models COLING 2024

Analyzing Occupational Distribution Representation in Japanese Language Models COLING 2024

How Much Annotation is Needed to Compare Summarization Models? NAACL 2024

Benchmark Generation Framework With Customizable Distortions for Image Classifier Robustness WACV 2024

What's Outside the Intersection? Fine-Grained Error Analysis for Semantic Segmentation Beyond IoU WACV 2024

UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling NIPS 2024

Aequitas Flow: Streamlining Fair ML Experimentation JMLR 2024

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models NAACL 2024

TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models ACL 2024