conftrace_

multiple choice

55 papers

Explore in graph

Also known as

MC

Co-occurring keywords

question answering (2963) large language model (13587) benchmark evaluation (1556) reading comprehension (377) commonsense reasoning (506) machine reading comprehension (430) multiple-choice question (44) natural language understanding (846) natural language inference (1287) text classification (6793)

Papers

LuxDiagRC: A Diagnostic Reading Comprehension Corpus for Luxembourgish with Linguistic and Cognitive Annotation Layers EACL 2026
Small Models Exhibit Limited Answer Consistency in Repetition Trials of the Multiple-Choice MMLU-Redux and MedQA Benchmarks AAAI 2026
MizanQA: A Benchmark for Multi-Answer Moroccan Legal QA EACL 2026
An Evaluation of Classifiers for Mapping Generative LLM Responses to Answer Options of Multiple-choice Questionnaires EACL 2026
GroundCocoa: A Benchmark for Evaluating Compositional & Conditional Reasoning in Language Models NAACL 2025
ARC ‘Challenge’ Is Not That Challenging ACL 2025
SinhalaMMLU: A Comprehensive Benchmark for Evaluating Multitask Language Understanding in Sinhala EMNLP 2025
Overview of the ClinIQLink 2025 Shared Task on Medical Question-Answering ACL 2025
On the Human-level Performance of Visual Question Answering COLING 2025
D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Models ACL 2025
KazBench-KK: A Cultural-Knowledge Benchmark for Kazakh ACL 2025
WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging ACL 2025
COLUMBUS: Evaluating COgnitive Lateral Understanding Through Multiple-Choice reBUSes AAAI 2025
Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation EMNLP 2024
Large Language Models' Expert-level Global History Knowledge Benchmark (HiST-LLM) NIPS 2024
JN666 at SemEval-2024 Task 7: NumEval: Numeral-Aware Language Understanding and Generation NAACL 2024
LAR-ECHR: A New Legal Argument Reasoning Task and Dataset for Cases of the European Court of Human Rights EMNLP 2024
HIJLI_JU at SemEval-2024 Task 7: Enhancing Quantitative Question Answering Using Fine-tuned BERT Models NAACL 2024
Exploring Automated Distractor Generation for Math Multiple-choice Questions via Large Language Models NAACL 2024
From Generation to Selection: Findings of Converting Analogical Problem-Solving into Multiple-Choice Questions EMNLP 2024
Strengthened Symbol Binding Makes Large Language Models Reliable Multiple-Choice Selectors ACL 2024
AmazUtah_NLP at SemEval-2024 Task 9: A MultiChoice Question Answering System for Commonsense Defying Reasoning NAACL 2024
JN666 at SemEval-2024 Task 7: NumEval: Numeral-Aware Language Understanding and Generation SEMEVAL 2024
“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models ACL 2024
DeBERTa at SemEval-2024 Task 9: Using DeBERTa for Defying Common Sense SEMEVAL 2024