multiple choice

An Evaluation of Classifiers for Mapping Generative LLM Responses to Answer Options of Multiple-choice Questionnaires EACL 2026 LuxDiagRC: A Diagnostic Reading Comprehension Corpus for Luxembourgish with Linguistic and Cognitive Annotation Layers EACL 2026 MizanQA: A Benchmark for Multi-Answer Moroccan Legal QA EACL 2026 Small Models Exhibit Limited Answer Consistency in Repetition Trials of the Multiple-Choice MMLU-Redux and MedQA Benchmarks AAAI 2026 ARC ‘Challenge’ Is Not That Challenging ACL 2025 COLUMBUS: Evaluating COgnitive Lateral Understanding Through Multiple-Choice reBUSes AAAI 2025 D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Models ACL 2025 GroundCocoa: A Benchmark for Evaluating Compositional & Conditional Reasoning in Language Models NAACL 2025 KazBench-KK: A Cultural-Knowledge Benchmark for Kazakh ACL 2025 On the Human-level Performance of Visual Question Answering COLING 2025 Overview of the ClinIQLink 2025 Shared Task on Medical Question-Answering ACL 2025 SinhalaMMLU: A Comprehensive Benchmark for Evaluating Multitask Language Understanding in Sinhala EMNLP 2025 WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025 DeBERTa at SemEval-2024 Task 9: Using DeBERTa for Defying Common Sense SemEval 2024 Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation EMNLP 2024 Exploring Automated Distractor Generation for Math Multiple-choice Questions via Large Language Models NAACL 2024 From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions EMNLP 2024 HIJLI_JU at SemEval-2024 Task 7: Enhancing Quantitative Question Answering Using Fine-tuned BERT Models SemEval 2024 JN666 at SemEval-2024 Task 7: NumEval: Numeral-Aware Language Understanding and Generation SemEval 2024 LAR-ECHR: A New Legal Argument Reasoning Task and Dataset for Cases of the European Court of Human Rights EMNLP 2024 Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) NeurIPS 2024 “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models ACL 2024 PUB: A Pragmatics Understanding Benchmark for Assessing LLMs’ Pragmatics Capabilities ACL 2024 Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors ACL 2024 AlGhafa Evaluation Benchmark for Arabic Language Models EMNLP 2023