Cognitive Biases · Learning
Overfitting
Tuning a model or rule so closely to past data that it fits the noise, so it explains the past well and predicts the future poorly.
Evidence grade: Statistical. How we grade evidence
For example
A team builds a scoring formula with dozens of tweaks until it matches last year's grant outcomes almost perfectly. Applied to this year's applicants, it ranks them badly.
Spot it in your week
Three quick questions. Your answers stay on this page.
Your DecisionDNA™ can tell you which biases you're most exposed to.
Find your DecisionDNA™Sources
Related entries
- Best PracticesChesterton's fenceFinding out why a rule, process or program was put in place before removing it. If no...
- Best PracticesThe Mom TestAsk people about their past behavior, not their opinion of your idea, so even your mom...
- Best PracticesValue of informationAsking, before gathering more data, whether any likely result would change the...
Bias of the week
One decision trap a week, in plain English. Unsubscribe any time.
We send one confirmation email first. What we keep.
Get the countermeasure
Get the countermeasure and the decisions where this bites, free in the Volley app.
