conftrace_

multiple choice evaluation

8 papers

Explore in graph

Co-occurring keywords · papers mentioning both

large language model (3) multiple choice (3) evaluation methodology (2) educational testing (1) group relative policy optimization (1) ranking consistency (1) entropy analysis (1) arc challenge (1) log probability (1) persian language (1)

Papers

Mitigating Selection Bias in Large Language Models via Permutation-Aware GRPO ACL 2026 ARC ‘Challenge’ Is Not That Challenging ACL 2025 D-GEN: Automatic Distractor Generation and Evaluation for Reliable Assessment of Generative Models ACL 2025 PerCoR: Evaluating Commonsense Reasoning in Persian via Multiple-Choice Sentence Completion IJCNLP 2025 Wait, that’s not an option: LLMs Robustness with Incorrect Multiple-Choice Options ACL 2025 Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above ACL 2025 “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models ACL 2024 Self-Recognition in Language Models EMNLP 2024