data contamination

Dealing with Synthetic Data Contamination in Online Continual Learning NeurIPS 2024 DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks ICLR 2024 FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language Models EMNLP 2024 Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models ACL 2024 Investigating Data Contamination in Modern Benchmarks for Large Language Models NAACL 2024 Investigating the Impact of Data Contamination of Large Language Models in Text-to-SQL translation ACL 2024 KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models ACL 2024 Language Models are Surprisingly Fragile to Drug Names in Biomedical Benchmarks EMNLP 2024 LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction AAAI 2024 Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs EACL 2024 MathPile: A Billion-Token-Scale Pretraining Corpus for Math NeurIPS 2024 MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks NAACL 2024 On Leakage of Code Generation Evaluation Datasets EMNLP 2024 PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations NeurIPS 2024 Probing Language Models for Pre-training Data Detection ACL 2024 StructEval: Deepen and Broaden Large Language Model Assessment via Structured Evaluation ACL 2024 Time Travel in LLMs: Tracing Data Contamination in Large Language Models ICLR 2024 To the Cutoff... and Beyond? A Longitudinal Perspective on LLM Data Contamination ICLR 2024 Unveiling the Spectrum of Data Contamination in Language Model: A Survey from Detection to Remediation ACL 2024 VarBench: Robust Language Model Benchmarking Through Dynamic Variable Perturbation EMNLP 2024 Can we trust the evaluation on ChatGPT? ACL 2023 Designing Robust Transformers using Robust Kernel Density Estimation NeurIPS 2023 NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark EMNLP 2023 Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4 EMNLP 2023 Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks EMNLP 2023