language model evaluation

VMLU Benchmarks: A comprehensive benchmark toolkit for Vietnamese LLMs ACL 2025 What am I missing here?: Evaluating Large Language Models for Masked Sentence Prediction IJCNLP 2025 When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification ACL 2025 A Closer Look at Claim Decomposition NAACL 2024 “A good pun is its own reword”: Can Large Language Models Understand Puns? EMNLP 2024 An Analysis of Multilingual FActScore EMNLP 2024 Anchor Points: Benchmarking Models with Much Fewer Examples EACL 2024 ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic ACL 2024 BertaQA: How Much Do Language Models Know About Local Culture? NeurIPS 2024 Can Language Models Recognize Convincing Arguments? EMNLP 2024 Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs? COLING 2024 DanteLLM: Let’s Push Italian LLM Research Forward! COLING 2024 Detection and Measurement of Syntactic Templates in Generated Text EMNLP 2024 Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NeurIPS 2024 Efficient Benchmarking (of Language Models) NAACL 2024 Elo Uncovered: Robustness and Best Practices in Language Model Evaluation NeurIPS 2024 Evaluating the Effectiveness of Large Language Models in Establishing Conversational Grounding EMNLP 2024 Eval-UA-tion 1.0: Benchmark for Evaluating Ukrainian (Large) Language Models COLING 2024 Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers EMNLP 2024 Finding Blind Spots in Evaluator LLMs with Interpretable Checklists EMNLP 2024 FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in LLMs EMNLP 2024 Fusion-Eval: Integrating Assistant Evaluators with LLMs EMNLP 2024 Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation EACL 2024 GREEN: Generative Radiology Report Evaluation and Error Notation EMNLP 2024 HumanRankEval: Automatic Evaluation of LMs as Conversational Assistants NAACL 2024