The earth is round (p<.05) – Personal health budgets and randomised controlled trials
The title of this post is from one of my favourite statistical thinkers (don’t judge me!), Jacob Cohen 1 , in an article arguing that the logic of statistical hypothesis testing (the p<0.05 bit) simply doesn’t fit many important research questions, and that making a fetish of statistical hypothesis testing may actually impede sensible research that can make a useful difference to the world. “Consider the following: A colleague approaches me with a statistical problem. He believes that a generally rare disease does not exist at all in a given population, hence H 0 : P=0. He draws a more or less random sample of 30 cases from this population and finds that one of the cases has the disease, hence P s =1/30=.033. He is not sure how to test H 0 , chi-square with Yates’s (1951) correction or the Fisher exact test, and wonders whether he has enough power. Would you believe it? And would you believe that if he tried to publish this result without a significance test, one or more reviewers m...