Exam 6: Evaluating the Merits of Quantitative Research Studies in Kinesiology

There is always a clear answer to the question "Is construct validity supported?"

You conduct a correlational study on the relationship between physical activity levels and carbohydrate intake. You collect all of your data on a single measurement occasion using a questionnaire measuring physical activity levels and carbohydrate intake. What types of validity can you use to evaluate whether your study is any good?

Logical validity is all-or-nothing; a research study is either logically valid or it is not.

In contrast to experimental study designs, which types of validity evidence are not relevant to correlational study designs?

A researcher is interested in knowing whether or not a revolutionary dynamic strength-training program aids in developing general flexibility beyond standard daily flexibility exercises alone for individuals above 65 years of age living in Edmonton. She has hypothesized that this effect might be different for males and females because of the specific exercises that are used in the dynamic strength-training program. Describe a study design that would best enable her to answer her research question. This description should include participant selection and data analysis, as well as the specific design strategy.

Knudson, Elliott, and Ackland (2012) provide an overview of principles that researchers can use to accurately cite research evidence when writing their own research manuscripts. List five of their principles.

Undergraduate students cannot have their names included on published research studies.

The specific sample identified in a research study is an irrelevant factor in the evaluation of logical validity.

Which of the following refers to the validity of the measure(s) using a research study?

Experimental studies are always better than other types of studies.

Henrich, Heine, and Norenzayan (2010) discuss how researchers often rely on WEIRD samples to conduct their research. What does WEIRD stand for?

If a particular exercise training intervention only works with a very specific sample under very specific laboratory conditions, the external validity would necessarily be very low.

Describe why non-random selection of participants (e.g., volunteers) poses such a high threat to the external validity of research studies in kinesiology.

Does a correlation in the magnitude of r = .36, between a measure (Measure 1) and another measure (Measure 2) of a similar construct, support the construct validity of the first measure (Measure 1)?

Provide a research example of "blinding", and using your example discuss why blinding is so important to high quality experimental research.

Within your area of research interest, identify a theoretical construct that you would need to measure in a quantitative study. Next, identify a measure or instrument that you might use to assess that theoretical construct. Lastly, provide specific examples of three types of construct validity evidence that you could evaluate to support your use of that measure or instrument.

Which kind of validity refers to the quality of researchers' arguments, their application of theory to support the needs for the study, and the appropriate interpretation of results based on the data?

The development of a nomological network can be useful in evaluating what type of validity?

Which of the following needs to be read in order to adequately evaluate the logical validity of a research study published in a journal?

Randomized control trial research designs are often considered the "gold standard" of experimental research.