Question

Discuss the issue of generalizability in statistics. Here, this means that we can make generalized statements or draw conclusions about a population based on the information gathered in a sample.

What factors do we need to consider in order that samples drawn from a population are really representative of that population? Be specific in your explanation.

Answer 1

The following factors should be consider in order that samples drawn from a population are really representative of that population:

Consistency

It is important that researchers understand the population on a case-by-case basis and test the sample for consistency before going ahead with the survey. This is especially critical for surveys that track changes across time and space where we need to be confident that any change we see in our data reflects real change – across consistent and comparable samples.

Diversity

Ensuring diversity of the sample is a tall order, as reaching some portions of the population and convincing them to participate in the survey could be difficult. But to be truly representative of the population, a sample must be as diverse as the population itself and sensitive to the local differences that are unavoidable as we move across the population.

Transparency

There are several constraints that dictate the size and structure of the population. It is imperative that researchers discuss these limitations and maintain transparency about the procedures followed while selecting the sample so that the results of the survey are seen with the right perspective.