Co-occurring keywords · papers mentioning both
Papers
MCQFormatBench: Robustness Tests for Multiple-Choice Questions
ACL 2025
MCQG-SRefine: Multiple Choice Question Generation and Evaluation with Iterative Self-Critique, Correction, and Comparison Feedback
NAACL 2025
Metric assessment protocol in the context of answer fluctuation on MCQ tasks
ACL 2025
Mitigating Selection Bias with Node Pruning and Auxiliary Options
ACL 2025
MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark
ACL 2025
None of the Above, Less of the Right Parallel Patterns in Human and LLM Performance on Multi-Choice Questions Answering
ACL 2025
OLMES: A Standard for Language Model Evaluations
NAACL 2025
PalmX 2025: The First Shared Task on Benchmarking LLMs on Arabic and Islamic Culture
EMNLP 2025
Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine
ACL 2025
PersianMCQ-Instruct: A Comprehensive Resource for Generating Multiple-Choice Questions in Persian
COLING 2025
QIAS 2025: Overview of the Shared Task on Islamic Inheritance Reasoning and Knowledge Assessment
EMNLP 2025
Quantifying and Mitigating Selection Bias in LLMs: A Transferable LoRA Fine-Tuning and Efficient Majority Voting Approach
IJCNLP 2025
Training Medical QA Models Based on Mixed Rewards from Multiple-Choice and Open-Ended Questions
EMNLP 2025
UBench: Benchmarking Uncertainty in Large Language Models with Multiple Choice Questions
ACL 2025
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
ACL 2024
Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation
ICML 2024
Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models
ACL 2024
Can Multiple-choice Questions Really Be Useful in Detecting the Abilities of LLMs?
COLING 2024
DE-COP: Detecting Copyrighted Content in Language Models Training Data
ICML 2024
DisGeM: Distractor Generation for Multiple Choice Questions with Span Masking
EMNLP 2024
Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation
EMNLP 2024
Distractor Generation Using Generative and Discriminative Capabilities of Transformer-based Models
COLING 2024
DiVERT: Distractor Generation with Variational Errors Represented as Text for Math Multiple-choice Questions
EMNLP 2024
E-EVAL: A Comprehensive Chinese K-12 Education Evaluation Benchmark for Large Language Models
ACL 2024
Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration
ACL 2024