language model evaluation

221 papers

Explore in graph

Also known as

LLM EVALUATION LME LLM LMS

Co-occurring keywords

large language model (12755) language model (4573) benchmark evaluation (1539) multilingual nlp (1423) natural language understanding (845) text generation (2903) low-resource language (2234) evaluation benchmark (250) text classification (6776) question answering (2904)

Papers

That Ain’t Right: Assessing LLM Performance on QA in African American and West African English Dialects EMNLP 2025

GEMBA V2: Ten Judgments Are Better Than One EMNLP 2025

RTP-LX: Can LLMs Evaluate Toxicity in Multilingual Scenarios? AAAI 2025

TEXT-CAKE: Challenging Language Models on Local Text Coherence COLING 2025

When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification ACL 2025

CoKe: Customizable Fine-Grained Story Evaluation via Chain-of-Keyword Rationalization ACL 2025

YNU-HPCC at SemEval-2025 Task3: Leveraging Zero-Shot Learning for Halluciantion Detection ACL 2025

Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs EMNLP 2025

Compositionality and Event Retrieval in Complement Coercion: A Study of Language Models in a Low-resource Setting CONLL 2025

Beyond Surprisal: A Dual Metric Framework for Lexical Skill Acquisition in LLMs COLING 2025

Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede’s Cultural Dimensions COLING 2025

DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent AAAI 2025

Do Language Models Understand the Cognitive Tasks Given to Them? Investigations with the N-Back Paradigm ACL 2025

Com2 : A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models ACL 2025

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models NAACL 2025

Trick or Neat: Adversarial Ambiguity and Language Model Evaluation ACL 2025

MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset ACL 2025

Evaluating Pretrained Causal Language Models for Synonymy ACL 2025

ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models ACL 2025

Less Can be More: An Empirical Evaluation of Small and Large Language Models for Sentence-level Claim Detection ACL 2025

HuGME: A benchmark system for evaluating Hungarian generative LLMs ACL 2025

Make Every Letter Count: Building Dialect Variation Dictionaries from Monolingual Corpora EMNLP 2025

VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs ACL 2025

Think Globally, Group Locally: Evaluating LLMs Using Multi-Lingual Word Grouping Games EMNLP 2025

Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine ACL 2025