How does significance level of a statistical test relate to our
decision about whether an independent variable had an effect? How
does our choice of significance level impact the likelihood of
making a Type I and a Type II error? Be sure to thoroughly
distinguish between the two types of errors.
What is the significance of the title Big Fish? How does this
relate to the folk saying about being a “big fish in a little
pond”? Does Edward Bloom become more than or less than a “big
fish”? Provide an example from the text to support your answer.
When we carry out a statistical test with significance level α =
5%, the probability of rejecting the null hypothesis when it is
true is 5%. Suppose that we independently select 5 random samples
of size 100, and for each sample carry out the same statistical
test with significance level 5%. We know that the null hypothesis
is true. What is the probability that we reject the null hypothesis
at most once out of the 5 tests?
Conceptually, what are we doing when we test for statistical
significance (such as in a z-test or t-test)? Where does the
commonly used 95% confidence level come from? What is an effect
size and what additional information does it provide about a
finding?
What does statistical significance mean? How do you know if
something is statistically significant? What is the difference
between statistical significance and practical significance?
Explain the concept of “statistical learning” and why it is
important. How does it relate to “rule learning”, as discussed by
Marcus. At what age do babies show evidence of statistical learning
and how has this been demonstrated? What about rule learning? Why
is it more than just memorizing the exact sound sequences or
syllables that they have heard?
What is the difference between practical and statistical
significance?
A. Statistical significance is associated with p values, but
practical significance is not.
B. Practical significance is associated with p values, but
statistical significance is not.
C. There is no difference.
D. Neither A nor B is true.