Deck 5: Reliability Overview: Classical Test Theory

Question 1

________ is the primary concern of reliability.

A) Prediction
B) Transparency
C) Consistency
D) Impartiality

Answer 1

C

Question 2

In Classical Test Theory, T represents the ________.

A) hypothetical score the test taker would receive if the measure contained zero error
B) observed score
C) reliability of the measure
D) amount of error relative to score obtained by the test taker.

Answer 2

A

Question 3

In Classical Test Theory, a measure's error is assumed to be ________.

A) constant across administrations
B) random
C) an indicator of bias
D) eliminated through standardization of administration

Answer 3

B

Question 4

Reliability can be conceptually viewed as a ratio of ________.

A)
B)
C)
D)

Question 5

Classical Test Theory considers how many sources of error at a time?

A) 1
B) 2
C) 4
D) An unlimited number

Question 6

If a measure randomly assigned scores to each participant, the measure would possess a reliability equal to ________.

A) -1.0
B) 0
C) 0.5
D) 1.0

Question 7

A research measure was found to have a reliability of .85. The researcher concluded that 15% of the variability in observed scores reflected ________.

A) true score variance
B) bias
C) systematic error
D) measurement error

Question 8

If scores from a measure with less than perfect reliability are correlated with scores from a second measure, the resulting correlation can be expected to be ________.

A) near zero
B) attenuated
C) enhanced
D) a more accurate estimate of the population correlation

Question 9

All else being equal, increasing the length of a test would be expected to ________ the test's reliability.

A) increase
B) decrease
C) have no effect upon

Question 10

In Classical Test Theory, an individual's true score would be ________.

A) independent of the items composing the test
B) consistent across various operationalizations of the measure
C) dependent on the other test-takers administered the test
D) limited to the specific test administered

Question 11

Identify and explain each component of the formula in the basic conception of Classical Test Theory.

Question 12

Classical Test Theory makes two very important assumptions about the error in testing. Identify these two assumptions.

Question 13

Explain, in terms of true score variance and error variance, the impact on reliability of doubling the length of a test.

Question 14

A graduate student is concerned that the long length of his dissertation questionnaire will discourage participation. He believes, however, that many of the items on a self-created 40 item measure are repetitive, and he is considering decreasing the scale to 20 items. His original 40-item scale was pre-tested and found to have a reliability of .75. What would you recommend he do before proceeding with his plan to remove items from the measure?

Question 15

Explain the statement: Classical Test Theory is test dependent and sample dependent.