benchmark contamination

BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks ACL 2026 SPENCE: A Syntactic Probe for Detecting Contamination in NL2SQL Benchmarks ACL 2026 Test of Time: Rethinking Temporal Signal of Benchmark Contamination ACL 2026 Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs ACL 2026 When Flores Bloomz Wrong: Cross-Direction Contamination in Machine Translation Evaluation EACL 2026 ConsistencyChecker: Tree-based Evaluation of LLM Generalization Capabilities ACL 2025 Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index EMNLP 2025 Investigating How Pre-training Data Leakage Affects Models’ Reproduction and Detection Capabilities EMNLP 2025 MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark ACL 2025 Simulating Training Data Leakage in Multiple-Choice Benchmarks for LLM Evaluation AACL 2025 SSA: Semantic Contamination of LLM-Driven Fake News Detection EMNLP 2025 Unbiased Evaluation of Large Language Models from a Causal Perspective ICML 2025 Detecting Pretraining Data from Large Language Models ICLR 2024 On Leakage of Code Generation Evaluation Datasets EMNLP 2024 PaCoST: Paired Confidence Significance Testing for Benchmark Contamination Detection in Large Language Models EMNLP 2024 Quantifying Contamination in Evaluating Code Generation Capabilities of Language Models ACL 2024 What's In My Big Data? ICLR 2024