item response theory

Assessing the Quality of AI-Generated Exams: A Large-Scale Field Study AAAI 2026 K-12EduBench: A Benchmark for Evaluating Large Language Models’ Knowledge, Problem-Solving, and Educational Goal Cognition in K-12 Education AAAI 2026 Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory AAAI 2026 MAQuA: Multi-outcome Adaptive Question-Asking for Mental Health using Item Response Theory EACL 2026 MetaEval: Measuring the Discrimination of Benchmarks for Efficient LLM Evaluation AAAI 2026 Quantifying and Mitigating Socially Desirable Responding in LLMs: A Desirability-Matched Graded Forced-Choice Psychometric Study ACL 2026 Ranking Reasoning LLMs under Test-Time Scaling ACL 2026 Revisiting Generalization Across Difficulty Levels: It’s Not So Easy EACL 2026 A Bayesian Approach to Inferring Prerequisite Structures and Topic Difficulty in Language Learning ACL 2025 Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs ACL 2025 A Survey on Automated Distractor Evaluation in Multiple-Choice Tasks ACL 2025 Can LLMs Reliably Simulate Real Students’ Abilities in Mathematics and Reading Comprehension? ACL 2025 Do LLMs Give Psychometrically Plausible Responses in Educational Assessments? ACL 2025 Don’t Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation EMNLP 2025 Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive Testing AAAI 2025 INDRA: Iterative Difficulty Refinement Attention for MCQ Difficulty Estimation for Indic Languages AACL 2025 Investigating the Zone of Proximal Development of Language Models for In-Context Learning NAACL 2025 IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory ACL 2025 MERGE$^3$: Efficient Evolutionary Merging on Consumer-grade GPUs ICML 2025 Nonparametric Bayesian inference of item-level features in classifier combination UAI 2025 PATCH! Psychometrics-AssisTed BenCHmarking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics ACL 2025 Reliable and Efficient Amortized Model-based Evaluation ICML 2025 SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Prediction EMNLP 2025 Trustworthy AI Meets Educational Assessment: Challenges and Opportunities AAAI 2025 Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025