Question

I took an online sorting set. I categorized good and bad words with images of Fat people and Thin people. My data suggest a strong automatic preference for Thin people over Fat people. I was Using two keys on the keyboard which swapped after a session that was timed.

Name one potential reliability and one validity problem of the test

Answer 1

Note: This response is in UK English, please paste the response to MS Word and you should be able to spot discrepancies easily. Also, I have defined the concepts from scholarly sources below. I did not see it befitting to answer too much in personal response.

(Answer) Potential Reliability: “The idea behind reliability is that any significant results must be more than a one-off finding and be inherently repeatable.

Other researchers must be able to perform exactly the same experiment, under the same conditions and generate the same results. This will reinforce the findings and ensure that the wider scientific community will accept the hypothesis.

Without this replication of statistically significant results, the experiment and research have not fulfilled all of the requirements of testability.

This prerequisite is essential to a hypothesis establishing itself as an accepted scientific truth.” (Citation: Validity and Reliability by Martyn Shuttleworth)

Case in Point: There is only one type of visual simulation used in this test and not more than one apparent test subject who is making his choice. These are both elements of a sloppy research and do not call for the most accurate results.

Validity: “Validity encompasses the entire experimental concept and establishes whether the results obtained meet all of the requirements of the scientific research method.

For example, there must have been randomization of the sample groups and appropriate care and diligence shown in the allocation of controls. Even if your results are great, sloppy and inconsistent design will compromise your integrity in the eyes of the scientific community.

Internal validity dictates how an experimental design is structured and encompasses all of the steps of the scientific research method. Internal validity and reliability are at the core of any experimental design.

External validity is the process of examining the results and questioning whether there are any other possible causal relationships.”

(Citation: Validity and Reliability by Martyn Shuttleworth)

Case in Point: The keyboard controls get switched in the middle of the simulation. The subject participating in the test seems to be the same person analysing data. There should be a researcher taking down data while several test subjects pick between fat and thin people via properly functioning controls.

Conclusion: this method of research is sloppy, uncertain and inadequate.