← Keywords

language model evaluation

221 papers

Explore in graph

Also known as

LLM EVALUATION LME LLM LMS

Co-occurring keywords

large language model (12755) language model (4573) benchmark evaluation (1539) multilingual nlp (1423) natural language understanding (845) text generation (2903) low-resource language (2234) evaluation benchmark (250) text classification (6776) question answering (2904)

Papers

NCL-UoR at SemEval-2025 Task 3: Detecting Multilingual Hallucination and Related Observable Overgeneration Text Spans with Modified RefChecker and Modified SelfCheckGPT ACL 2025
GREEN: Generative Radiology Report Evaluation and Error Notation EMNLP 2024
Propagation and Pitfalls: Reasoning-based Assessment of Knowledge Editing through Counterfactual Tasks ACL 2024
“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models ACL 2024
Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models? EMNLP 2024
Can Language Models Recognize Convincing Arguments? EMNLP 2024
PrOnto: Language Model Evaluations for 859 Languages COLING 2024
DanteLLM: Let’s Push Italian LLM Research Forward! COLING 2024
Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models NIPS 2024
Should We Really Edit Language Models? On the Evaluation of Edited Language Models NIPS 2024
An Analysis of Multilingual FActScore EMNLP 2024
Detection and Measurement of Syntactic Templates in Generated Text EMNLP 2024
SciDQA: A Deep Reading Comprehension Dataset over Scientific Papers EMNLP 2024
Fusion-Eval: Integrating Assistant Evaluators with LLMs EMNLP 2024
Information Parity: Measuring and Predicting the Multilingual Capabilities of Language Models EMNLP 2024
Evaluating the Effectiveness of Large Language Models in Establishing Conversational Grounding EMNLP 2024
Anchor Points: Benchmarking Models with Much Fewer Examples EACL 2024
HypoTermQA: Hypothetical Terms Dataset for Benchmarking Hallucination Tendency of LLMs EACL 2024
UnMASKed: Quantifying Gender Biases in Masked Language Models through Linguistically Informed Job Market Prompts EACL 2024
LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction AAAI 2024
Generative Interpretation: Toward Human-Like Evaluation for Educational Question-Answer Pair Generation EACL 2024
L-Eval: Instituting Standardized Evaluation for Long Context Language Models ACL 2024
Language Models can Evaluate Themselves via Probability Discrepancy ACL 2024
SINAI at SemEval-2024 Task 8: Fine-tuning on Words and Perplexity as Features for Detecting Machine Written Text SEMEVAL 2024
Eval-UA-tion 1.0: Benchmark for Evaluating Ukrainian (Large) Language Models COLING 2024