Machine Reading Comprehension

LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks ACL 2025 LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-Context QA ACL 2025 Long Context Benchmark for the Russian Language EMNLP 2025 Long-Form Information Alignment Evaluation Beyond Atomic Facts EMNLP 2025 LongTableBench: Benchmarking Long-Context Table Reasoning across Real-World Formats and Domains EMNLP 2025 Masking in Multi-hop QA: An Analysis of How Language Models Perform with Context Permutation ACL 2025 McHirc: A Multimodal Benchmark for Chinese Idiom Reading Comprehension AAAI 2025 MedOdyssey: A Medical Domain Benchmark for Long Context Evaluation Up to 200K Tokens NAACL 2025 Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewards EMNLP 2025 MESAQA: A Dataset for Multi-Span Contextual and Evidence-Grounded Question Answering COLING 2025 MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoning COLING 2025 MiniLongBench: The Low-cost Long Context Understanding Benchmark for Large Language Models ACL 2025 MinosEval: Distinguishing Factoid and Non-Factoid for Tailored Open-Ended QA Evaluation with LLMs ACL 2025 MMCR: Benchmarking Cross-Source Reasoning in Scientific Papers ICCV 2025 MMSciBench: Benchmarking Language Models on Chinese Multimodal Scientific Problems ACL 2025 MMXU: A Multi-Modal and Multi-X-ray Understanding Dataset for Disease Progression ACL 2025 Morables: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables EMNLP 2025 MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs ACL 2025 MultiHoax: A Dataset of Multi-hop False-premise questions ACL 2025 Multi-Sourced Compositional Generalization in Visual Question Answering IJCAI 2025 MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL COLING 2025 NoLiMa: Long-Context Evaluation Beyond Literal Matching ICML 2025 NovelQA: Benchmarking Question Answering on Documents Exceeding 200K Tokens ICLR 2025 PhD: A ChatGPT-Prompted Visual Hallucination Evaluation Dataset CVPR 2025 PIPER: Benchmarking and Prompting Event Reasoning Boundary of LLMs via Debiasing-Distillation Enhanced Tuning ACL 2025