Skip to content
conftrace_
2026 AISTATS AISTATS 2026

Undersmoothing Black-Box Models for Functional Estimation

We study functional estimation using black-box models through a model-agnostic undersmoothing framework. The proposed procedure Rep operates by augmenting the original dataset through replicating a proportion of samples multiple times, and subsequently applying the black-box algorithm to the augmented dataset. This construction automatically induces undersmoothing and reduces the functional estimation error. We provide several empirical demonstrations (including neural network based learners) showing that compared to the plug-in estimator, the proposed algorithm Rep improves the estimation accuracy of functional estimation without requiring explicit expressions for the associated influence functions. Furthermore, we develop a theoretical analysis in two representative settings, the Nadaraya–Watson estimator and the random feature model, establishing that replication provides explicit prescriptions for the replication proportion and number of copies, and yields optimal convergence rates for functional estimation. In the classical nonparametric regression setting, we extend Rep with a Lepski-style method that adapts to unknown structural features of the regression function.

More from AISTATS 2026

All AISTATS 2026 papers →