Question

In: Statistics and Probability

What is the relationship between the simple two-sample t-test and the Bonferroni method of multiple comparisons?

What is the relationship between the simple two-sample t-test and the Bonferroni method of multiple comparisons?

Solutions

Expert Solution

The exact statement of your null hypothesis determines whether a Bonferroni correction applies. If you have a list of t-tests and a significant result for even one of those t-tests rejects the null-hypothesis, then Bonferroni correction (or similar).

Let's assume your hypothesis is "this instrument does not exhibit DIF", and you are going to test the hypothesis by looking at the statistical significance probabilities reported for each t-test in a list of t-tests. Then, by chance, we would expect 1 out of every 20 or so t-tests to report p≤.05. So, if there are more than 20 t-tests in the list, then p≤.05 for an individual t-test is a meaningless significance. In fact, if we don't see at least one p≤.05, we may be surprised!

The Bonferroni correction says, "if any of the t-tests in the list has p≤.05/(number of t-tests in the list), then the hypothesis is rejected".

What is important is the number of tests, not how many of them are reported to have p≤.05

If you wish to make a Bonferroni multiple-significance-test correction, compare the reported significance probability with your chosen significance level, e.g., .05, divided by the number of t-tests in the Table. According to Bonferroni, if you are testing the null hypothesis at the p≤.05 level: "There is no effect in this test." Then the most significant effect must be p≤.05 / (number of item DIF contrasts) for the null hypothesis of no-effect to be rejected.


Related Solutions

What is the relationship between One-Sample Test, Two-Sample Test, Analysis of Variance, and Regression? How do...
What is the relationship between One-Sample Test, Two-Sample Test, Analysis of Variance, and Regression? How do you decide on which test to perform?
What are some possible reasons for two-sample t-test to have no statistical difference between the two...
What are some possible reasons for two-sample t-test to have no statistical difference between the two groups. The hypothesis of the test is determine to find if the two-sample test is larger than a certain amount. Please provide some reasons.
What is the difference between the Goodness of fit test and the one-sample t-test?
What is the difference between the Goodness of fit test and the one-sample t-test?
Find the difference between the two groups when using a dependent t-test then find the independent two-sample t-test
data = X1= 14, 8, 6, 14, 20, 13, 9, 12 x2= 13, 4, 1, 8, 10, 12, 8, 6 1. Find the difference between the two groups when using a dependent t-test then find the independent two-sample t-test, and compare the results with those from the dependent t-test
What are the differences between inpedenpedent samples t-test, paired sample t-test, Wilcoxon rank-sum test, and the...
What are the differences between inpedenpedent samples t-test, paired sample t-test, Wilcoxon rank-sum test, and the Wilcoxon signed ranks test? Thank you!
what are the differences between: 1. one sample z-test 2. one sample t-test 3. independent sample...
what are the differences between: 1. one sample z-test 2. one sample t-test 3. independent sample t-test 4. dependent sample t-test 5. what type of information comes from a known population vs. your sample data
Compute both a paired t-test and two-sample t-test (for practice) but report the t-value for the...
Compute both a paired t-test and two-sample t-test (for practice) but report the t-value for the correct test. XI (Girl Guides) X2 (Boy Scouts) 9 6 9 7 5 5 10 8 6 5 8 6 6 7 7 5 9 4 6 7
The two-sample t-test is applied to compare whether the average difference between two groups is significant...
The two-sample t-test is applied to compare whether the average difference between two groups is significant or if it is due instead to random chance. Use good references, 1. Briefly, describe the difference between Unpaired Two-Sample T-test and Paired Two-Sample T-test. 2. Provide an application example for Unpaired Two-Sample T-test, and stablish the Ho and Ha Hypotheses. 3. Provide an application example for Paired Two-Sample T-test, and stablish the Ho and Ha Hypotheses. 4. Explain the purpose of P-values and...
What is the difference between a Paired t-test and a Pooled t-test?
What is the difference between a Paired t-test and a Pooled t-test?
List two variables that you could study the relationship between using an independent groups t-test. for...
List two variables that you could study the relationship between using an independent groups t-test. for each variable, indicate if the variable is (1) the IV or DV, (2) nominal, ordinal, interval, or ratio, and (3) the values of each variable.
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT