← Keywords

language model evaluation

221 papers

Explore in graph

Also known as

LLM EVALUATION LME LLM LMS

Co-occurring keywords

large language model (12755) language model (4573) benchmark evaluation (1539) multilingual nlp (1423) natural language understanding (845) text generation (2903) low-resource language (2234) evaluation benchmark (250) text classification (6776) question answering (2904)

Papers

Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events ACL 2025
When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification ACL 2025
YNU-HPCC at SemEval-2025 Task3: Leveraging Zero-Shot Learning for Halluciantion Detection ACL 2025
Compositionality and Event Retrieval in Complement Coercion: A Study of Language Models in a Low-resource Setting CONLL 2025
Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede’s Cultural Dimensions COLING 2025
Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Games EMNLP 2025
Less Can be More: An Empirical Evaluation of Small and Large Language Models for Sentence-level Claim Detection ACL 2025
IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025
HuGME: A benchmark system for evaluating Hungarian generative LLMs ACL 2025
AnaScore: Understanding Semantic Parallelism in Proportional Analogies NAACL 2025
VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs ACL 2025
LLMs Do Not See Age: Assessing Demographic Bias in Automated Systematic Review Synthesis IJCNLP 2025
That Ain’t Right: Assessing LLM Performance on QA in African American and West African English Dialects EMNLP 2025
BehaviorBox: Automated Discovery of Fine-Grained Performance Differences Between Language Models ACL 2025
TounsiBench: Benchmarking Large Language Models for Tunisian Arabic EMNLP 2025
Trick or Neat: Adversarial Ambiguity and Language Model Evaluation ACL 2025
MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset ACL 2025
OLMES: A Standard for Language Model Evaluations NAACL 2025
CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025
Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025
Measuring the Effect of Disfluency in Multilingual Knowledge Probing Benchmarks EMNLP 2025
Semantic Inversion, Identical Replies: Revisiting Negation Blindness in Large Language Models EMNLP 2025
From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models EMNLP 2025
Can Large Language Models Unlock Novel Scientific Research Ideas? EMNLP 2025
TEXT-CAKE: Challenging Language Models on Local Text Coherence COLING 2025