Skip to content
conftrace_

data contamination

79 papers

Papers

Benchmarking LLMs’ Mathematical Reasoning with Unseen Random Variables Questions AAAI 2026 Beyond Next Token Probabilities: Learnable, Fast Detection of Hallucinations and Data Contamination on LLM Output Distributions AAAI 2026 Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees ACL 2026 Does Question Really Matter? The Attribution of Answer Bias in LLM Evaluation AAAI 2026 LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models ACL 2026 Quantifying Data Contamination in Psychometric Evaluations of LLMs EACL 2026 Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination AAAI 2026 SDEval: Safety Dynamic Evaluation for Multimodal Large Language Models AAAI 2026 Adaptive Deviation Learning for Visual Anomaly Detection with Data Contamination WACV 2025 AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledge ACL 2025 BALSAM: A Platform for Benchmarking Arabic Large Language Models EMNLP 2025 Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation EMNLP 2025 Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM EMNLP 2025 C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation ACL 2025 Contamination Budget: Trade-offs Between Breadth, Depth and Difficulty IJCAI 2025 CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025 DCR: Quantifying Data Contamination in LLMs Evaluation EMNLP 2025 Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025 DyCodeEval: Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination ICML 2025 DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation ACL 2025 Dynamic Multimodal Evaluation with Flexible Complexity by Vision-Language Bootstrapping ICLR 2025 Establishing Trustworthy LLM Evaluation via Shortcut Neuron Analysis ACL 2025 Exposing the Achilles’ Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical Reasoning ACL 2025 Identifying Pre-training Data in LLMs: A Neuron Activation-Based Detection Framework EMNLP 2025 Identifying Unlearned Data in LLMs via Membership Inference Attacks EMNLP 2025