item response theory

66 papers

Explore in graph

Also known as

IRT

Co-occurring keywords

large language model (12755) computerized adaptive testing (10) educational assessment (77) difficulty estimation (14) ability estimation (6) knowledge tracing (65) adaptive testing (13) bayesian inference (1904) question generation (461) rasch model (3)

Papers

MetaEval: Measuring the Discrimination of Benchmarks for Efficient LLM Evaluation AAAI 2026

Assessing the Quality of AI-Generated Exams: A Large-Scale Field Study AAAI 2026

K-12EduBench: A Benchmark for Evaluating Large Language Models’ Knowledge, Problem-Solving, and Educational Goal Cognition in K-12 Education AAAI 2026

MAQuA: Multi-outcome Adaptive Question-Asking for Mental Health using Item Response Theory EACL 2026

Revisiting Generalization Across Difficulty Levels: It’s Not So Easy EACL 2026

Lost in Benchmarks? Rethinking Large Language Model Benchmarking with Item Response Theory AAAI 2026

Do LLMs Give Psychometrically Plausible Responses in Educational Assessments? ACL 2025

A Survey on Automated Distractor Evaluation in Multiple-Choice Tasks ACL 2025

PATCH! Psychometrics-AssisTed BenCHmarking of Large Language Models against Human Populations: A Case Study of Proficiency in 8th Grade Mathematics ACL 2025

INDRA: Iterative Difficulty Refinement Attention for MCQ Difficulty Estimation for Indic Languages AACL 2025

INDRA: Iterative Difficulty Refinement Attention for MCQ Difficulty Estimation for Indic Languages IJCNLP 2025

Investigating the Zone of Proximal Development of Language Models for In-Context Learning NAACL 2025

A Bayesian Approach to Inferring Prerequisite Structures and Topic Difficulty in Language Learning ACL 2025

Can LLMs Reliably Simulate Real Students’ Abilities in Mathematics and Reading Comprehension? ACL 2025

Don’t Sweat the Small Stuff: Segment-Level Meta-Evaluation Based on Pairwise Difference Correlation EMNLP 2025

Trustworthy AI Meets Educational Assessment: Challenges and Opportunities AAAI 2025

SMART: Simulated Students Aligned with Item Response Theory for Question Difficulty Prediction EMNLP 2025

IRT-Router: Effective and Interpretable Multi-LLM Routing via Item Response Theory ACL 2025

Explicit and Implicit Examinee-Question Relation Exploiting for Efficient Computerized Adaptive Testing AAAI 2025

Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs ACL 2025

Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025

BERT-IRT: Accelerating Item Piloting with BERT Embeddings and Explainable IRT Models NAACL 2024

ALBA: Adaptive Language-Based Assessments for Mental Health NAACL 2024

Do great minds think alike? Investigating Human-AI Complementarity in Question Answering with CAIMIRA EMNLP 2024

Item Response Theory for Natural Language Processing EACL 2024