Machine Reading Comprehension

Large Language Models Are Poor Clinical Decision-Makers: A Comprehensive Benchmark EMNLP 2024 Large Language Models Fall Short: Understanding Complex Relationships in Detective Narratives ACL 2024 LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction AAAI 2024 LFED: A Literary Fiction Evaluation Dataset for Large Language Models COLING 2024 LooGLE: Can Long-Context Language Models Understand Long Contexts? ACL 2024 M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models ACL 2024 MalAlgoQA: Pedagogical Evaluation of Counterfactual Reasoning in Large Language Models and Implications for AI in Education EMNLP 2024 Marathon: A Race Through the Realm of Long Context with Large Language Models ACL 2024 MDCR: A Dataset for Multi-Document Conditional Reasoning EMNLP 2024 MedExQA: Medical Question Answering Benchmark with Multiple Explanations ACL 2024 Mitigating Idiom Inconsistency: A Multi-Semantic Contrastive Learning Method for Chinese Idiom Reading Comprehension AAAI 2024 M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question Answering ACL 2024 MRC-based Nested Medical NER with Co-prediction and Adaptive Pre-training COLING 2024 MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Music IJCAI 2024 Multi-Granularity Guided Fusion-in-Decoder NAACL 2024 Multi-modal Concept Alignment Pre-training for Generative Medical Visual Question Answering ACL 2024 Multi-Review Fusion-in-Context NAACL 2024 MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning ICLR 2024 Needle In A Multimodal Haystack NeurIPS 2024 NLP at UC Santa Cruz at SemEval-2024 Task 5: Legal Answer Validation using Few-Shot Multi-Choice QA SemEval 2024 Once Upon a Replication: It is Humans’ Turn to Evaluate AI’s Understanding of Children’s Stories for QA Generation COLING 2024 One Thousand and One Pairs: A “novel” challenge for long-context language models EMNLP 2024 On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL NAACL 2024 On Narrative Question Answering Skills NAACL 2024 OSX at Context24: How Well Can GPT Tackle Contexualizing Scientific Figures and Tables ACL 2024