How Contaminated Is Your Benchmark? Measuring Dataset Leakage in Large Language Models with Kernel Divergence

Hyeong Kyu Choi; Maxim Khanov; Hongxin Wei; Yixuan Li

2025 ICML ICML 2025

How Contaminated Is Your Benchmark? Measuring Dataset Leakage in Large Language Models with Kernel Divergence

Abstract

No abstract available. No abstract was captured for this paper when its proceedings were scraped - most often an older edition published without one online. How the corpus is built.

❓ The Questioner

🌉 Interdisciplinary Bridge - Artificial Intelligence and Natural Language Processing

Authors

Hyeong Kyu Choi, Maxim Khanov, Hongxin Wei, Yixuan Li

Topics

Machine Learning > Core Methods > Representation Learning Natural Language Processing > Resources & Methods > Large Language Models Artificial Intelligence > Core AI > Large Language Models

Keywords

fine tuning large language model dataset leakage contamination level embedding similarity matrix kernel divergence score

Download PDF