Deck 9: Test Construction

Question 1

Which of the following has a correlation matrix as its output?

A)Item-total analysis
B)Cronbach's alpha
C)Test-retest reliability
D)Criterion-related validity
E)None of the above

Answer 1

A

Question 2

When conducting an item-total analysis, the items in the scale are considered internally consistent when all of the item-total correlations are:

A)Greater than 1.0
B)Less than 1.0
C)Greater than 0.7
D)Less than 0.7
E)Greater than 0.3

Answer 2

C

Question 3

Which of the following is NOT true for criterion-related validity?

A)Determines the extent to which the scale produces similar results over time.
B)Determines the extent to which the scale you are testing correlates with a criterion.
C)Determines whether the measure is valid for its intended purpose.
D)Determines whether a scale is measuring what it says it is measuring.
E)Requires that all items be measured on an interval or ratio scale.

Answer 3

A

Question 4

Which of the following is FALSE about Cronbach's alpha?

A)All items must be measured on an interval or ratio scale.
B)It is a way to determine if you are measuring the correct construct.
C)It is a test of the internal consistency of a test.
D)It is a way to assess the reliability of a test.
E)It determines the degree to which all the items measure the same construct.

Question 5

Test-retest reliability is:

A)a measure of validity.
B)a measure of internal consistency.
C)a measure of consistency over time.
D)a measure of the same kind of reliability as Cronbach's alpha.

Question 6

When assessing the value of your Cronbach's alpha,

A)Numbers close to 1.00 indicate poor internal consistency.
B)Numbers close to 0.00 indicate poor internal consistency.
C)Numbers close to 1.00 indicate poor reliability.
D)Numbers close to 0.00 indicate excellent reliability.
E)You hope the number is less than 0.00.

Question 7

Which of the following is NOT true for the test-retest reliability coefficient?

A)It is a correlation coefficient for the relationship between total scores on two administrations of the same measure.
B)It is calculated using the Pearson r correlation coefficient with the two administrations of the measure as the two variables.
C)It should be positive.
D)It is considered strong if it is close to 1.00.
E)It is considered strong if it is close to 0.00.

Question 8

Which of the following is NOT an aspect of Item-total analysis?

A)All items must be measured on an interval or ratio scale.
B)It is a test of the internal consistency of a test.
C)It is a way to assess the reliability of a test.
D)It is a way to assess the validity of the construct in the test.
E)It determines the degree to which all the items measure the same construct.

Question 9

What are the assumptions for item-total analysis?
I)All items should be measured on an interval or ratio scale.
II)Each item should be normally distributed.
III)The analysis is conducted using Pearson r but can be conducted with Spearman rho if the data are ordinal in nature.

A)I only
B)II only
C)III only
D)I & II only
E)I, II, & III

Question 10

When conducting an item-total analysis, if an item-total correlation is negative, you should:

A)Report the correlation as negative.
B)Average the correlation with the other correlations.
C)Remove the question and recalculate the analysis.
D)Remove the question only if the item-total correlation is below 0.3.
E)Add another question and recalculate the analysis.