Cognitive Biases · Belief

P-hacking

Also called: Data dredging, Garden of forking paths

Running many analyzes or cuts of the data and reporting only the ones that give the result you wanted.

Evidence grade: Strong. How we grade evidence

For example

An analyst slices the donor survey by age, region, gift size and channel until one cut shows the new campaign worked. The report to the board shows only that cut.

DECIDE BETTER® · Rule 3Data answers your questionEvery data set answers somebody's question. Make sure it's yours, or you end up precisely wrong and only generally right.

Spot it in your week

Three quick questions. Your answers stay on this page.

  1. Did you look at the same data several different ways this week before settling on the view you shared?
  2. In a meeting this week, did someone present one chart or breakdown without saying how many others were tried?
  3. Did you read a report this week that showed only the slice of the numbers that supported its point?

Your DecisionDNA™ can tell you which biases you're most exposed to.

Find your DecisionDNA™

Sources

Related entries

Get the countermeasure

Get the countermeasure and the decisions where this bites, free in the Volley app.

See the Volley app