In: Math
Why is it “harder” to find a significant outcome (all other things being equal) when the research hypothesis is being tested at the .01 rather than the .05 level of significance?
Solution:
According to the p value approach , if p value is less than the level of significance ,then we reject the null hypothesis and the test is said to be significant. If the p value is greater than the level of significance , we fail to reject the null hypothesis and the test is said to be Not significant.
Suppose , we used 0.05 level of significance and suppose our p value of the test is 0.023. Here the p value is less than significance level.In this case we reject the null hypothesis and test is significant .
But , suppose we now used 0.01 level of significance. Since here the p value is greater than significance level. , we fail to reject the null hypothesis and we said that the test is Not significant.
So, it is “harder” to find a significant outcome (all other things being equal) when the research hypothesis is being tested at the .01 rather than the .05 level of significance?