Cognitive Biases · Belief
Algorithmic bias
Also called: Proxy bias, Biased training data, Label bias
A model repeats or widens unfair patterns in its data, often because it predicts a stand-in measure, such as past spending, in place of the real goal, such as need.
Evidence grade: Strong. How we grade evidence
For example
A county uses a model to decide which households get priority for help. The model predicts past service use, and households that had trouble reaching services show low use, so they rank low.
A caution
A property of data and models. Ask what the model was trained to predict, and on whom.
Spot it in your week
Three quick questions. Your answers stay on this page.
Your DecisionDNA™ can tell you which biases you're most exposed to.
Find your DecisionDNA™Sources
Related entries
- Cognitive BiasesAI hallucinationAn AI model states something false or made up, such as a fake citation or number, in...
- Cognitive BiasesBase Rate fallacyIgnoring how common something is overall when judging how likely it is in a specific case.
- Cognitive BiasesComposition fallacyAssuming that what is true for a part is also true for the whole.
Bias of the week
One decision trap a week, in plain English. Unsubscribe any time.
We send one confirmation email first. What we keep.
Get the countermeasure
Get the countermeasure and the decisions where this bites, free in the Volley app.
