Deck 9: Validity for Decisions: Criterion-Related Validity

Question 1

Obtaining both test scores and criterion scores from some intact, preselected population, and then correlating the scores, is an example of _______.

A) concurrent validity
B) predictive validity
C) construct validity
D) criterion-referenced validity

Answer 1

A

Question 2

Two general strategies for assessing criterion-related validity are

A) content and construct validity
B) predictive and construct validity
C) concurrent and predictive validity
D) construct and concurrent validity

Answer 2

C

Question 3

Criterion measures are often chosen

A) based on previous research
B) based on statistical procedures
C) in a systematic manner
D) in a haphazard manner

Answer 3

D

Question 4

The percentage of people in the population who are successful according to some criterion is the

A) selection ratio
B) success ratio
C) selection rate
D) base rate

Question 5

Trying to estimate a person's score on a particular measure on the basis of that person's score on some other measure is referred to as

A) decision
B) prediction
C) criterion
D) explication

Question 6

Meta-Analysis:

A) allows us to combine the results of previous validity research
B) is not used very frequently due to lack of acceptance among statisticians
C) says that previous validity research should not be considered in evaluating the criterion-related validity of a test
D) is designed to allow you to combine tests that measure similar constructs

Question 7

________ is a generic term which represents a variety of more practical methods for assessing validity.

A) criterion-relations
B) predictive validity
C) concurrent validity
D) decision referenced validity

Question 8

A validity study is conducted in the workplace, where many workers have had many years of on-the-job experience. This study is probably a _______ validity study.

A) predictive
B) concurrent
C) construct
D) content

Question 9

The population in a concurrent validity study is ________ than the population in a predictive validity study.

A) less selective
B) more selective
C) smaller
D) larger

Question 10

The most fundamental difference between predictive and concurrent validity strategies is that

A) there are no fundamental differences
B) concurrent validity coefficients are obtained in a random sample
C) predictive validity coefficients are obtained in a random sample
D) criterion scores are obtained at different times

Question 11

A practical objection to predictive validity strategies is that

A) a large sample is needed
B) the population in the study is similar to the population of applicants
C) random selection is done for some applicants
D) the decision maker must select some applicants who will fail

Question 12

The accuracy of decisions is directly linked to the __________ of test scores.

A) validity
B) reliability
C) representativeness
D) sample

Question 13

The correlation between test scores and criterion scores represents

A) reliability
B) content validity
C) validity
D) both b and c

Question 14

Studying correlations between test scores obtained before making decisions, and criterion scores obtained after making decisions is an example of a _________ strategy.

A) predictive validity
B) concurrent validity
C) construct validity
D) decision making

Question 15

A ________ represents some action which you take on the basis of your _______.

A) prediction; decision
B) decision; prediction
C) criterion; predictor
D) directive; assessment

Question 16

Test theory suggests that concurrent validity coefficients underestimate population validity. What does research suggest?

A) Concurrent validity coefficients do, in fact, underestimate population validity.
B) Concurrent validity coefficients are often similar in size to predictive validities.
C) Concurrent validity coefficients seriously overestimate population validity.
D) Concurrent validity coefficients seriously attenuate population validity.

Question 17

The ideal criterion-related validity strategy is

A) predictive validity
B) concurrent validity
C) construct validity
D) face validity

Question 18

Correlating test scores with some measure of success is the same thing as correlating test scores with some

A) concurrent validation
B) sample referenced norm
C) other test scores
D) criterion

Question 19

A criterion-related validity of 0.50 indicates that approximately ______ percent of the variability of performance can be accounted for by the test scores.

A) 99.5
B) 50
C) 25
D) 10

Question 20

Range restriction is most likely to occur in

A) concurrent validity studies
B) predictive validity studies
C) construct validity studies
D) both a and b

Question 21

Researchers have moved toward a unitary definition of validity in which all validation is _______ validation.

A) construct
B) content
C) criterion-related
D) none of the above

Question 22

A low base rate makes it likely that you will have many

A) true positives and false negatives
B) true negatives and false positives
C) true negatives and false negatives
D) true positives and false positives

Question 23

A ________ is an example of a decision error.

A) true positive
B) true negative
C) false negative
D) both a and c

Question 24

If 100 people apply for 4 jobs, the selection ratio is

A) )25
B) )04
C) )50
D) )30

Question 25

Johnny has SAT scores in the 92nd percentile area, and a high school GPA of 3.7. He is accepted into a prestigious university, but flunks out during his junior year. Johnny is an example of a

A) true positive
B) true negative
C) false positive
D) false negative