← Keywords

language model evaluation

221 papers

Explore in graph

Also known as

LLM EVALUATION LME LLM LMS

Co-occurring keywords

large language model (12755) language model (4573) benchmark evaluation (1539) multilingual nlp (1423) natural language understanding (845) text generation (2903) low-resource language (2234) evaluation benchmark (250) text classification (6776) question answering (2904)

Papers

Counterfactual reasoning: Testing language models’ understanding of hypothetical scenarios ACL 2023
MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks NIPS 2023
A Better Way to Do Masked Language Model Scoring ACL 2023
A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing EMNLP 2023
ORCA: A Challenging Benchmark for Arabic Language Understanding ACL 2023
Building Socio-culturally Inclusive Stereotype Resources with Community Engagement NIPS 2023
“John is 50 years old, can his son be 65?” Evaluating NLP Models’ Understanding of Feasibility EACL 2023
Selective-LAMA: Selective Prediction for Confidence-Aware Evaluation of Language Models EACL 2023
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models EMNLP 2022
A Knowledge-Graph-Based Intrinsic Test for Benchmarking Medical Concept Embeddings and Pretrained Language Models EMNLP 2022
Language Models Are Poor Learners of Directional Inference EMNLP 2022
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance EMNLP 2022
On the Cusp of Comprehensibility: Can Language Models Distinguish Between Metaphors and Nonsense? EMNLP 2022
Curriculum: A Broad-Coverage Benchmark for Linguistic Phenomena in Natural Language Understanding NAACL 2022
Using Natural Sentence Prompts for Understanding Biases in Language Models NAACL 2022
Psycholinguistic Diagnosis of Language Models’ Commonsense Reasoning ACL 2022
Beyond Static models and test sets: Benchmarking the potential of pre-trained models across tasks and languages ACL 2022
How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns NAACL 2022
A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation NAACL 2022
BECEL: Benchmark for Consistency Evaluation of Language Models COLING 2022
DiscoSense: Commonsense Reasoning with Discourse Connectives EMNLP 2022
ChapterBreak: A Challenge Dataset for Long-Range Language Models NAACL 2022
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios COLING 2022
This is the way: designing and compiling LEPISZCZE, a comprehensive NLP benchmark for Polish NIPS 2022
Testing the Ability of Language Models to Interpret Figurative Language NAACL 2022