Skip to content
conftrace_
2026 ICML ICML 2026

Position: Reframing Hallucination: Latent Space Geodesics as a Pathway for Generative Discovery

Although evaluation practice for generative models has moved beyond purely retrieval-based metrics, many protocols still penalize deviations from known outputs, limiting their use in scientific discovery and creative reasoning. This position paper argues that uniformly suppressing such deviations can induce epistemic mode collapse, causing models to favor safe reproduction over exploratory hypothesis generation. We propose the Higher-Dimensional Cognitive Hypothesis (HDCH), which interprets some valuable hallucinations as high-dimensional latent-space traversals that appear erroneous when projected onto established knowledge. We distinguish Type I outputs, which are factually inconsistent or structurally incoherent, from Type II exploratory hypotheses, which are novel, structurally coherent, and worth further validation. Through controlled demonstrations, we illustrate that discovery-oriented generation benefits from calibrated instability, with exploratory yield peaking near a critical transition regime rather than increasing monotonically with randomness. We further advocate an Exploratory Signal-to-Noise Ratio (ESNR) framework that combines distributional divergence with external structural validation, shifting evaluation from static retrieval validation toward calibrated latent exploration.

More from ICML 2026

All ICML 2026 papers →