language model evaluation

Auto-PRE: An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation AAAI 2026 AwarenessBench: Assessing Cognitive Capabilities of Language Models ACL 2026 CharBench: Evaluating the Role of Tokenization in Character-Level Tasks AAAI 2026 Comparing human and language models sentence processing difficulties on complex structures ACL 2026 CxMP: A Linguistic Minimal-Pair Benchmark for Evaluating Constructional Understanding in Language Models ACL 2026 False Friends or Cognates? A Cross-lingual Semantic Ambiguity Evaluation for Galician, Portuguese and Spanish ACL 2026 Far Out: Evaluating Language Models on Slang in Australian and Indian English EACL 2026 Hey, wait a minute: on at-issue sensitivity in Language Models EACL 2026 Learning to Judge: LLMs Designing and Applying Evaluation Rubrics EACL 2026 Revisiting a Pain in the Neck: A Semantic Reasoning Benchmark for Language Models ACL 2026 TinyJudge: Unverifiable Constraint Alignment via Lightweight Specialist Ensembles ACL 2026 When Do Language Models Endorse Limitations on Human Rights Principles? EACL 2026 100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability? ACL 2025 Adaptively profiling models with task elicitation EMNLP 2025 AdTEC: A Unified Benchmark for Evaluating Text Quality in Search Engine Advertising NAACL 2025 A Fair Comparison without Translationese: English vs. Target-language Instructions for Multilingual LLMs NAACL 2025 Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning Benchmarks EMNLP 2025 Analyzing Political Bias in LLMs via Target-Oriented Sentiment Classification ACL 2025 AnaScore: Understanding Semantic Parallelism in Proportional Analogies NAACL 2025 A Statistical Framework for Ranking LLM-based Chatbots ICLR 2025 AutoBencher: Towards Declarative Benchmark Construction ICLR 2025 BanglaMATH : A Bangla benchmark dataset for testing LLM mathematical reasoning at grades 6, 7, and 8 EMNLP 2025 Batayan: A Filipino NLP benchmark for evaluating Large Language Models ACL 2025 BehaviorBox: Automated Discovery of Fine-Grained Performance Differences Between Language Models ACL 2025 Beyond Surprisal: A Dual Metric Framework for Lexical Skill Acquisition in LLMs COLING 2025