conftrace_

data contamination

69 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) language model (4599) dynamic evaluation (17) model evaluation (445) code generation (746) membership inference (114) contamination detection (7) llm evaluation (141)

Papers

Benchmarking LLMs’ Mathematical Reasoning with Unseen Random Variables Questions AAAI 2026
Controllable Contamination Detection for Reliable LLM Evaluation with Statistical Guarantees ACL 2026
LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models ACL 2026
Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination AAAI 2026
Quantifying Data Contamination in Psychometric Evaluations of LLMs EACL 2026
Beyond Next Token Probabilities: Learnable, Fast Detection of Hallucinations and Data Contamination on LLM Output Distributions AAAI 2026
SDEval: Safety Dynamic Evaluation for Multimodal Large Language Models AAAI 2026
Does Question Really Matter? The Attribution of Answer Bias in LLM Evaluation AAAI 2026
CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluation ACL 2025
TripleFact: Defending Data Contamination in the Evaluation of LLM-driven Fake News Detection ACL 2025
QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluation EMNLP 2025
Identifying Unlearned Data in LLMs via Membership Inference Attacks EMNLP 2025
Identifying Pre-training Data in LLMs: A Neuron Activation-Based Detection Framework EMNLP 2025
DCR: Quantifying Data Contamination in LLMs Evaluation EMNLP 2025
UnSeenTimeQA: Time-Sensitive Question-Answering Beyond LLMs’ Memorization ACL 2025
LNE-Blocking: An Efficient Framework for Contamination Mitigation Evaluation on Large Language Models EMNLP 2025
Establishing Trustworthy LLM Evaluation via Shortcut Neuron Analysis ACL 2025
C2LEVA: Toward Comprehensive and Contamination-Free Language Model Evaluation ACL 2025
BALSAM: A Platform for Benchmarking Arabic Large Language Models EMNLP 2025
Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models NAACL 2025
User Behavior Prediction as a Generic, Robust, Scalable, and Low-Cost Evaluation Strategy for Estimating Generalization in LLMs ACL 2025
DynaCode: A Dynamic Complexity-Aware Code Benchmark for Evaluating Large Language Models in Code Generation ACL 2025
Benchmarking Large Language Models Under Data Contamination: A Survey from Static to Dynamic Evaluation EMNLP 2025
Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM EMNLP 2025
Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions NAACL 2025