language model evaluation

Evaluating Pretrained Causal Language Models for Synonymy ACL 2025 ExpliCa: Evaluating Explicit Causal Reasoning in Large Language Models ACL 2025 Fann or Flop: A Multigenre, Multiera Benchmark for Arabic Poetry Understanding in LLMs EMNLP 2025 Few-Shot Prompting, Full-Scale Confusion: Evaluating Large Language Models for Humor Detection in Croatian Tweets ACL 2025 Financial Language Model Evaluation (FLaME) ACL 2025 Fine-Grained Constraint Generation-Verification for Improved Instruction-Following ACL 2025 From Understanding to Generation: An Efficient Shortcut for Evaluating Language Models EMNLP 2025 GEMBA V2: Ten Judgments Are Better Than One EMNLP 2025 Guardrails, not Guidance: Understanding Responses to LGBTQ+ Language in Large Language Models NAACL 2025 Hallucinations in Code Change to Natural Language Generation: Prevalence and Evaluation of Detection Metrics IJCNLP 2025 Hard Emotion Test Evaluation Sets for Language Models NAACL 2025 Hatevolution: What Static Benchmarks Don’t Tell Us ACL 2025 HPSS: Heuristic Prompting Strategy Search for LLM Evaluators ACL 2025 HuGME: A benchmark system for evaluating Hungarian generative LLMs ACL 2025 IberoBench: A Benchmark for LLM Evaluation in Iberian Languages COLING 2025 Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge ICLR 2025 Learning to Align Multi-Faceted Evaluation: A Unified and Robust Framework ACL 2025 Less Can be More: An Empirical Evaluation of Small and Large Language Models for Sentence-level Claim Detection ACL 2025 LLMs Do Not See Age: Assessing Demographic Bias in Automated Systematic Review Synthesis IJCNLP 2025 LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks ACL 2025 Long Context Benchmark for the Russian Language EMNLP 2025 Luna: A Lightweight Evaluation Model to Catch Language Model Hallucinations with High Accuracy and Low Cost COLING 2025 Make Every Letter Count: Building Dialect Variation Dictionaries from Monolingual Corpora EMNLP 2025 MALAMUTE: A Multilingual, Highly-granular, Template-free, Education-based Probing Dataset ACL 2025 Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language ACL 2025