Overview
The following sections outline some approaches to predicting
and estimating generalization ability, either a priori from static parameters
such as network size, or after observing training performance. The problem of
estimating the true performance of a prediction system trained on a limited data
set is a basic statistics problem so it is not surprising that many of these
methods are direct applications of statistical techniques. Techniques mentioned
here are covered in more depth in [44], [389], [317].