Definitions
from Wiktionary, Creative Commons Attribution/ShareAlike License.
 verb statistics To use a
statistical model that has too manyparameters relative to the size of the sample leading to a good fit with the sample data but a poor fit with new data.
Etymologies
from Wiktionary, Creative Commons Attribution/ShareAlike License
Examples

This is, in some ways, the worst kind of overfit because the selection process is unpenalized re: the number of candidates tested. i.e.

Next, if they are structually unstable then what would this mean for the overfit parameters that are derived through the trialanderror process that you describe basically, a genetic algorithm?

If one stands in the shoes of the people doing reconstructions with changing temperature series, they should either be, at least, somewhat concerned that these results indicate that the reconstructions were overfit or, if not, they must be very concerned about the legitimacy of the temperature changes and be publicizing that point.

The uncertainty is in regard to the degree of accuracy of the reconstructions which ARE based on overfit models.

I have heard someone here complain of “overfit” reconstructions.

Next, if they are structually unstable then what would this mean for the overfit parameters that are derived through the trialanderror process that you describe basically, a genetic algorithm?

You can check whether it is overfit or no: divide data to two parts, repeat the procedure and verify that the order of most correlated series does not change.

If the GCMs work well for an idealized parameter say, GMT because they are overfit to that parameter, then the lack of fit to some other equally meaningful parameter would put them under suspicion.

It doesn't take many knobs or turns of them to overfit a model when data snooping past results.

But if you have divergence problem, it cannot be overfit at the same time
Comments
Log in or sign up to get involved in the conversation. It's quick and easy.