conftrace_

data contamination

69 papers

Explore in graph

Co-occurring keywords

large language model (13587) benchmark evaluation (1556) evaluation benchmark (257) language model (4599) dynamic evaluation (17) model evaluation (445) code generation (746) membership inference (114) contamination detection (7) llm evaluation (141)

Papers

Dealing with Synthetic Data Contamination in Online Continual Learning NIPS 2024
LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction AAAI 2024
PertEval: Unveiling Real Knowledge Capacity of LLMs with Knowledge-Invariant Perturbations NIPS 2024
Unveiling the Spectrum of Data Contamination in Language Model: A Survey from Detection to Remediation ACL 2024
DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph NIPS 2024
KIEval: A Knowledge-grounded Interactive Evaluation Framework for Large Language Models ACL 2024
Probing Language Models for Pre-training Data Detection ACL 2024
Investigating the Impact of Data Contamination of Large Language Models in Text-to-SQL translation ACL 2024
Data Contamination Report from the 2024 CONDA Shared Task ACL 2024
Generalization or Memorization: Data Contamination and Trustworthy Evaluation for Large Language Models ACL 2024
Designing Robust Transformers using Robust Kernel Density Estimation NIPS 2023
NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark EMNLP 2023
Can we trust the evaluation on ChatGPT? ACL 2023
Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4 EMNLP 2023
Stop Uploading Test Data in Plain Text: Practical Strategies for Mitigating Data Contamination by Evaluation Benchmarks EMNLP 2023
Language Contamination Helps Explains the Cross-lingual Capabilities of English Pretrained Models EMNLP 2022
Data Contamination: From Memorization to Exploitation ACL 2022
Understanding and Mitigating Data Contamination in Deep Anomaly Detection: A Kernel-based Approach IJCAI 2022
Saving Stochastic Bandits from Poisoning Attacks via Limited Data Verification AAAI 2022