Deck 13: Measurement in Research

Question 1

Which statement is false?

A) Reliability and validity are dependent on the test and the characteristics of the group tested.
B) Objectivity, reliability, and validity, in that order, must be determined for a test.
C) An intraclass correlation coefficient is used to estimate test reliability and test objectivity.
D) Validity is estimated by one of two different methods.
E) It is recommended that a researcher know that a test has the essential characteristics before collecting data in a study.

Answer 1

D

Question 2

Select the false statement below.

A) The essential characteristics associated with any test are objectivity, reliability, and validity.
B) In any situation, calculate an intraclass correlation coefficient (R) to estimate test score reliability.
C) The three basic approaches to obtaining validity information are logical, criterion, and construct.
D) Reliability is required to have validity.
E) There are two types of reliability, internal consistency and stability.

Answer 2

B

Question 3

Select the false statement about desirable characteristics of test scores and the interpretations of the test scores.

A) The three essential characteristics for a test are validity, reliability, and objectivity.
B) Validity is the degree to which interpretations based on test scores are correct.
C) Reliability is the degree to which scores of people are the same on two different occasions.
D) Validity and reliability may be dependent on characteristics of the group like age and gender.
E) Seldom are researchers concerned about how economical (test time per person, equipment needed, etc.) a test is.

Answer 3

E

Question 4

Which statement below is true?

A) There are several correlation techniques and coefficients that are used to estimate reliability.
B) There are several approaches to gathering validity evidence.
C) The criterion score influences the formula used to calculate R.
D) Objectivity is also called rater reliability.
E) All of the statements are true.

Question 5

Which statement below is false?

A) With repeated measures (trials) for each person, the criterion score is the mean score.
B) The criterion score selected determines the R formula.
C) Values determined by using ANOVA are used to calculate R.
D) A common criterion score is the mean of the repeated measures for a person.
E) The Reliability program in SPSS provides information that can be used to calculate several different R-values.

Question 6

In regard to the criterion validity approach:

A) ideally the criterion is the gold standard.
B) usually the validity coefficient is less than one.
C) it may be impossible to use this approach for lack of a criterion.
D) All of these are correct.

Question 7

In regard to the construct validity approach:

A) it is an approach to use if no other approach is possible.
B) it is not a very precise approach.
C) any type of evidence can be used to demonstrate validity.
D) it is seldom used in some areas of kinesiology.
E) the maximum construct validity value is 1.0.

Question 8

Determining a running test's ability to predict VO₂max is an example of evidence based on:

A) internal structure.
B) relation to other variable.
C) test content.
D) response process.

Question 9

Examining if a test-criterion relationship can be applied to a new situation is an example of:

A) external structure.
B) test reliability.
C) validity generalization.
D) test content validity.

Question 10

Determining if fitness testing changed students' behavior is an example of evidence based on:

A) internal structure.
B) consequence of testing.
C) test content.
D) response process.