Co-occurring keywords · papers mentioning both
Papers
Every Answer Matters: Evaluating Commonsense with Probabilistic Measures
ACL 2024
EXAMS-V: A Multi-Discipline Multilingual Multimodal Exam Benchmark for Evaluating Vision Language Models
ACL 2024
Findings from the First Shared Task on Automated Prediction of Difficulty and Response Time for Multiple-Choice Questions
NAACL 2024
HANS, are you clever? Clever Hans Effect Analysis of Neural Systems
NAACL 2024
Improving Automated Distractor Generation for Math Multiple-choice Questions with Overgenerate-and-rank
NAACL 2024
Is Your Large Language Model Knowledgeable or a Choices-Only Cheater?
ACL 2024
Large Language Models Are Not Robust Multiple Choice Selectors
ICLR 2024
Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions
NAACL 2024
Marathon: A Race Through the Realm of Long Context with Large Language Models
ACL 2024
“My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language Models
ACL 2024
Plausibly Problematic Questions in Multiple-Choice Benchmarks for Commonsense Reasoning
EMNLP 2024
SafetyBench: Evaluating the Safety of Large Language Models
ACL 2024
ToMBench: Benchmarking Theory of Mind in Large Language Models
ACL 2024
Benchmarking Large Language Models on CMExam - A comprehensive Chinese Medical Exam Dataset
NeurIPS 2023
Distractor Generation based on Text2Text Language Models with Pseudo Kullback-Leibler Divergence Regulation
ACL 2023
Increasing Probability Mass on Answer Choices Does Not Always Improve Accuracy
EMNLP 2023
DeepQR: Neural-Based Quality Ratings for Learnersourced Multiple-Choice Questions
AAAI 2022
Evaluating the Knowledge Dependency of Questions
EMNLP 2022
ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Data
ACL 2021
Knowledge-Driven Distractor Generation for Cloze-Style Multiple Choice Questions
AAAI 2021
On the application of Transformers for estimating the difficulty of Multiple-Choice Questions from text
EACL 2021
When Retriever-Reader Meets Scenario-Based Multiple-Choice Questions
EMNLP 2021
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies.
EMNLP 2020
A Method for Building a Commonsense Inference Dataset based on Basic Events
EMNLP 2020
Automatic Distractor Generation for Multiple Choice Questions in Standard Tests
COLING 2020