← Keywords

model evaluation

442 papers

Explore in graph

Co-occurring keywords

large language model (12755) benchmark evaluation (1539) text classification (6776) language model (4573) natural language processing (2027) evaluation benchmark (250) natural language inference (1278) multimodal learning (4622) bias detection (419) transfer learning (5442)

Papers

XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models NAACL 2024
How Much Annotation is Needed to Compare Summarization Models? NAACL 2024
A Multilevel Analysis of PubMed-only BERT-based Biomedical Models NAACL 2024
Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification AAAI 2024
Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models ACL 2024
UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs ACL 2024
LLMBox: A Comprehensive Library for Large Language Models ACL 2024
The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Models ACL 2024
Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation ACL 2024
GAOKAO-MM: A Chinese Human-Level Benchmark for Multimodal Models Evaluation ACL 2024
Evaluating Gender Bias in Multilingual Multimodal AI Models: Insights from an Indian Context ACL 2024
Large Language Models are not Fair Evaluators ACL 2024
Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination EMNLP 2024
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations EMNLP 2024
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges EMNLP 2024
Evalverse: Unified and Accessible Library for Large Language Model Evaluation EMNLP 2024
PaCoST: Paired Confidence Significance Testing for Benchmark Contamination Detection in Large Language Models EMNLP 2024
Are Large Language Models (LLMs) Good Social Predictors? EMNLP 2024
Self-Evaluation of Large Language Model based on Glass-box Features EMNLP 2024
SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists EMNLP 2024
Self-Recognition in Language Models EMNLP 2024
Are Large Language Models Consistent over Value-laden Questions? EMNLP 2024
Assessing “Implicit” Retrieval Robustness of Large Language Models EMNLP 2024
On the Relationship between Truth and Political Bias in Language Models EMNLP 2024
What Kind of Sourcery is This? Evaluating GPT-4’s Performance on Linking Scientific Fact to Citations EMNLP 2024