In: Statistics and Probability
What is the difference between testwise alpha level and experiment wise alpha level?
Test wise alpha level :-
The test wise alpha level is a risk of type 1 error for an individual hypothesis test.
Or Test wise alpha level is the total probability of a type I error that is accumulated from all of the individual tests in the experiment
Experiments wise alpha level :-
When an experiment involves several different hypothesis tests,
the experimentwise alpha
level is the total probability of a Type I error that is
accumulated from all of the individual tests in the
experiment. Typically, the experimentwise alpha level is
substantially greater than the value of alpha used
for any one of the individual tests.
We can also says that,
. When a single research study involves several hypothesis tests,
the testwise alpha level is the value
selected for each individual test and the experimentwise alpha
level is the total risk of a Type I error that is
accumulated for all of the separate tests.