Cognitive Biases · Belief

Selection bias

Also called: Sampling bias

Drawing conclusions from cases that got into your data for a reason tied to the result, so they do not represent the whole.

Evidence grade: Statistical. How we grade evidence

For example

A training program surveys only people who finished it and finds they love it. People who dropped out are not in the data. Leaders conclude the whole program works well.

DECIDE BETTER® · Rule 3Data answers your questionEvery data set answers somebody's question. Make sure it's yours, or you end up precisely wrong and only generally right.

Spot it in your week

Three quick questions. Your answers stay on this page.

  1. In the last week, did you draw a conclusion from data that left out people who dropped out or never joined?
  2. Did a discussion this week rely on feedback from only those who chose to respond?
  3. Did a report you read this week describe results from a group that was not picked at random?

Your DecisionDNA™ can tell you which biases you're most exposed to.

Find your DecisionDNA™

Sources

Related entries

In public budgets

Public comment and surveys hear from the people who show up, who may differ from everyone affected.

See it on Colorado Works Better⁠ (opens in a new tab)

Get the countermeasure

Get the countermeasure and the decisions where this bites, free in the Volley app.

See the Volley app