language model evaluation

221 papers

Explore in graph

Also known as

LLM EVALUATION LME LLM LMS

Co-occurring keywords

large language model (12755) language model (4573) benchmark evaluation (1539) multilingual nlp (1423) natural language understanding (845) text generation (2903) low-resource language (2234) evaluation benchmark (250) text classification (6776) question answering (2904)

Papers

Numerical Correlation in Text EMNLP 2022

Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models NIPS 2022

Towards Explainable Evaluation of Language Models on the Semantic Similarity of Visual Concepts COLING 2022

GiCCS: A German in-Context Conversational Similarity Benchmark EMNLP 2022

TestAug: A Framework for Augmenting Capability-based NLP Tests COLING 2022

Twitter Topic Classification COLING 2022

BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation EMNLP 2022

Intrinsic evaluation of language models for code-switching EMNLP 2021

Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema EMNLP 2021

CLiMP: A Benchmark for Chinese Language Model Evaluation EACL 2021

ALUE: Arabic Language Understanding Evaluation EACL 2021

Probing Language Models for Understanding of Temporal Expressions EMNLP 2021

What Can a Generative Language Model Answer About a Passage? EMNLP 2021

Who’s on First?: Probing the Learning and Representation Capabilities of Language Models on Deterministic Closed Domains EMNLP 2021

Evaluating language models for the retrieval and categorization of lexical collocations EACL 2021

Lower Perplexity is Not Always Human-Like IJCNLP 2021

Language Model Evaluation Beyond Perplexity IJCNLP 2021

Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data ACL 2020

The birth of Romanian BERT EMNLP 2020

Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs IJCNLP 2019

When Choosing Plausible Alternatives, Clever Hans can be Clever EMNLP 2019