Position: There are futures that benchmark-driven AI cannot see
Abstract
In biology, traits evolved for one function sometimes become decisive for another; this is exaptation, and scientific progress works the same way. AI’s benchmark-centered selection environment taxes exaptation: when one selection rule dominates, ideas that do not fit it have nowhere to persist. The cost grows acute as the field shifts from asking can machines exhibit intelligent behavior? to asking can they do so while remaining aligned, interpretable, and safe? These are philosophically distinct questions that may require discoveries we cannot specify. We propose mechanisms to restore exaptive capacity without abandoning benchmarking: plural evaluation regimes, protected venues for non-comparable work, long-horizon funding, and training norms that encourage researchers to question selection rules, not only optimize within them.