Question 1

The percentage of people in the population who are successful according to some criterion is the

Accepted Answer

A)  selection ratio 
B)  success ratio 
C)  selection rate 
D)  base rate 
A)  selection ratio 
B)  success ratio 
C)  selection rate 
D)  base rate D

Question 2

A criterion-related validity of 0.50 indicates that approximately ______ percent of the variability of performance can be accounted for by the test scores.

Accepted Answer

A)  99.5 
B)  50 
C)  25 
D)  10 
A)  99.5 
B)  50 
C)  25 
D)  10 C

Question 3

Researchers have moved toward a unitary definition of validity in which all validation is _______ validation.

Accepted Answer

A)  construct 
B)  content 
C)  criterion-related 
D)  none of the above 
A)  construct 
B)  content 
C)  criterion-related 
D)  none of the above A

Question 4

Trying to estimate a person's score on a particular measure on the basis of that person's score on some other measure is referred to as

Accepted Answer

A)  decision 
B)  prediction 
C)  criterion 
D)  explication 
A)  decision 
B)  prediction 
C)  criterion 
D)  explication

Question 5

The accuracy of decisions is directly linked to the __________ of test scores.

Accepted Answer

A)  validity 
B)  reliability 
C)  representativeness 
D)  sample 
A)  validity 
B)  reliability 
C)  representativeness 
D)  sample

Question 6

The ideal criterion-related validity strategy is

Accepted Answer

A)  predictive validity 
B)  concurrent validity 
C)  construct validity 
D)  face validity 
A)  predictive validity 
B)  concurrent validity 
C)  construct validity 
D)  face validity

Question 7

The most fundamental difference between predictive and concurrent validity strategies is that

Accepted Answer

A)  there are no fundamental differences 
B)  concurrent validity coefficients are obtained in a random sample 
C)  predictive validity coefficients are obtained in a random sample 
D)  criterion scores are obtained at different times 
A)  there are no fundamental differences 
B)  concurrent validity coefficients are obtained in a random sample 
C)  predictive validity coefficients are obtained in a random sample 
D)  criterion scores are obtained at different times

Question 8

Studying correlations between test scores obtained before making decisions, and criterion scores obtained after making decisions is an example of a _________ strategy.

Accepted Answer

A)  predictive validity 
B)  concurrent validity 
C)  construct validity 
D)  decision making 
A)  predictive validity 
B)  concurrent validity 
C)  construct validity 
D)  decision making

Question 9

A low base rate makes it likely that you will have many

Accepted Answer

A)  true positives and false negatives 
B)  true negatives and false positives 
C)  true negatives and false negatives 
D)  true positives and false positives 
A)  true positives and false negatives 
B)  true negatives and false positives 
C)  true negatives and false negatives 
D)  true positives and false positives

Question 10

Meta-Analysis:

Accepted Answer

A)  allows us to combine the results of previous validity research 
B)  is not used very frequently due to lack of acceptance among statisticians 
C)  says that previous validity research should not be considered in evaluating the criterion-related validity of a test 
D)  is designed to allow you to combine tests that measure similar constructs 
A)  allows us to combine the results of previous validity research 
B)  is not used very frequently due to lack of acceptance among statisticians 
C)  says that previous validity research should not be considered in evaluating the criterion-related validity of a test 
D)  is designed to allow you to combine tests that measure similar constructs

Question 11

A ________ represents some action which you take on the basis of your _______.

Accepted Answer

A)  prediction; decision 
B)  decision; prediction 
C)  criterion; predictor 
D)  directive; assessment 
A)  prediction; decision 
B)  decision; prediction 
C)  criterion; predictor 
D)  directive; assessment

Question 12

A practical objection to predictive validity strategies is that

Accepted Answer

A)  a large sample is needed 
B)  the population in the study is similar to the population of applicants 
C)  random selection is done for some applicants 
D)  the decision maker must select some applicants who will fail 
A)  a large sample is needed 
B)  the population in the study is similar to the population of applicants 
C)  random selection is done for some applicants 
D)  the decision maker must select some applicants who will fail

Question 13

Johnny has SAT scores in the 92nd percentile area, and a high school GPA of 3.7. He is accepted into a prestigious university, but flunks out during his junior year. Johnny is an example of a

Accepted Answer

A)  true positive 
B)  true negative 
C)  false positive 
D)  false negative 
A)  true positive 
B)  true negative 
C)  false positive 
D)  false negative

Question 14

Obtaining both test scores and criterion scores from some intact, preselected population, and then correlating the scores, is an example of _______.

Accepted Answer

A)  concurrent validity 
B)  predictive validity 
C)  construct validity 
D)  criterion-referenced validity 
A)  concurrent validity 
B)  predictive validity 
C)  construct validity 
D)  criterion-referenced validity

Question 15

Range restriction is most likely to occur in

Accepted Answer

A)  concurrent validity studies 
B)  predictive validity studies 
C)  construct validity studies 
D)  both a and b 
A)  concurrent validity studies 
B)  predictive validity studies 
C)  construct validity studies 
D)  both a and b

Question 16

The population in a concurrent validity study is ________ than the population in a predictive validity study.

Accepted Answer

A)  less selective 
B)  more selective 
C)  smaller 
D)  larger 
A)  less selective 
B)  more selective 
C)  smaller 
D)  larger

Question 17

A validity study is conducted in the workplace, where many workers have had many years of on-the-job experience. This study is probably a _______ validity study.

Accepted Answer

A)  predictive 
B)  concurrent 
C)  construct 
D)  content 
A)  predictive 
B)  concurrent 
C)  construct 
D)  content

Question 18

Two general strategies for assessing criterion-related validity are

Accepted Answer

A)  content and construct validity 
B)  predictive and construct validity 
C)  concurrent and predictive validity 
D)  construct and concurrent validity 
A)  content and construct validity 
B)  predictive and construct validity 
C)  concurrent and predictive validity 
D)  construct and concurrent validity

Question 19

Correlating test scores with some measure of success is the same thing as correlating test scores with some

Accepted Answer

A)  concurrent validation 
B)  sample referenced norm 
C)  other test scores 
D)  criterion 
A)  concurrent validation 
B)  sample referenced norm 
C)  other test scores 
D)  criterion

Question 20

Criterion measures are often chosen

Accepted Answer

A)  based on previous research 
B)  based on statistical procedures 
C)  in a systematic manner 
D)  in a haphazard manner 
A)  based on previous research 
B)  based on statistical procedures 
C)  in a systematic manner 
D)  in a haphazard manner

Exam 9: Validity for Decisions: Criterion-Related Validity

The percentage of people in the population who are successful according to some criterion is the

A criterion-related validity of 0.50 indicates that approximately ______ percent of the variability of performance can be accounted for by the test scores.

Researchers have moved toward a unitary definition of validity in which all validation is _______ validation.

Trying to estimate a person's score on a particular measure on the basis of that person's score on some other measure is referred to as

The accuracy of decisions is directly linked to the __________ of test scores.

The ideal criterion-related validity strategy is

The most fundamental difference between predictive and concurrent validity strategies is that

Studying correlations between test scores obtained before making decisions, and criterion scores obtained after making decisions is an example of a _________ strategy.

A low base rate makes it likely that you will have many

Meta-Analysis:

A ________ represents some action which you take on the basis of your _______.

A practical objection to predictive validity strategies is that

Johnny has SAT scores in the 92nd percentile area, and a high school GPA of 3.7. He is accepted into a prestigious university, but flunks out during his junior year. Johnny is an example of a

Obtaining both test scores and criterion scores from some intact, preselected population, and then correlating the scores, is an example of _______.

Range restriction is most likely to occur in

The population in a concurrent validity study is ________ than the population in a predictive validity study.

A validity study is conducted in the workplace, where many workers have had many years of on-the-job experience. This study is probably a _______ validity study.

Two general strategies for assessing criterion-related validity are

Correlating test scores with some measure of success is the same thing as correlating test scores with some

Criterion measures are often chosen

Tests and Measurements

Defining and Measuring Psychological Attributes: Ability, Interests, and Personality

Testing and Society

Basic Concepts in Measurement and Statistics

Scales, Transformations, and Norms

Reliability: the Consistency of Test Scores

Using and Interpreting Information About Test Reliability

Validity of Measurement: Content and Construct-Oriented Validation Strategies

Item Analysis

The Process of Test Development

Computerized Test Administration and Interpretation

Ability Testing: Individual Tests

Ability Testing: Group Tests

Issues in Ability Testing

Interest Testing

Personality Testing

Tests and Educational Decisions

Psychological Measurement in Industry

Diagnostic Testing: Clinical Applications

Issues in Multi-Method Assessment

Filters

A __ represents some action which you take on the basis of your _.