Question 1

To know how well each preliminary test item contributes to accurate prediction of the criterion, we would use

Accepted Answer

A)  item-difficulty index 
B)  item-reliability index 
C)  item-validity index 
D)  index of item discrimination

Question 2

What concept is best summed up by the question, "Does use of this test result in better patient outcomes or more efficient delivery of services?"

Accepted Answer

A)  test functionality 
B)  test utility 
C)  test generalizability 
D)  test efficacy

Question 3

It is common practice in test development that the prepublication version of a new instrument might contain ________the number of items desired on the final draft.

Accepted Answer

A)  fewer than 
B)  double 
C)  five times 
D)  ten times

Question 4

In order to investigate potential sex bias in a test item, we would examine an)

Accepted Answer

A)  item-characteristic curve 
B)  cumulative difficulty curve 
C)  normal ogive 
D)  summative distribution

Question 5

Which of the following scaling methods is considered the "gold standard"?

Accepted Answer

A)  expert rankings 
B)  Likert scale 
C)  Guttman scale 
D)  none of the above

Question 6

According to the functionalist perspective on test validity, a test is valid if

Accepted Answer

A)  inferences made from it are meaningful and appropriate 
B)  the test serves the purpose for which it is used 
C)  its screening function is proved effective 
D)  none of the above

Question 7

A construct is

Accepted Answer

A)  a theoretical, intangible quality or trait in which individuals differ 
B)  any variable which permits precise measurement 
C)  essentially synonymous with a concept 
D)  all of the above

Question 8

Which scale construction method guarantees that all scale items correlate positively with each other and also with the total score for the scale?

Accepted Answer

A)  empirical keying 
B)  equal-appearing intervals 
C)  rational scale construction 
D)  expert rankings

Question 9

In________ validity, test scores are used to estimate outcome measures obtained at a later date.

Accepted Answer

A)  content 
B)  concurrent 
C)  predictive 
D)  construct

Question 10

The index of item difficulty can vary from

Accepted Answer

A)  0 to 100 
B)  -1.0 to +1.0 
C)  0.0 to +1.0 
D)  0.5 to +1.0

Question 11

A factor loading is actually(an)_____

Accepted Answer

A)  beta weight 
B)  correlation 
C)  eigenvalue 
D)  all of the above

Question 12

A(n) _______scale has a conceptually meaningful zero point.

Accepted Answer

A)  nominal 
B)  ordinal 
C)  interval 
D)  ratio

Question 13

Factor loadings can vary between

Accepted Answer

A)  0 and 100 
B)  -1.0 and +1.0 
C)  0.0 and +1.0 
D)  none of the above

Question 14

The first step in test construction is

Accepted Answer

A)  defining the test 
B)  selecting a scaling method 
C)  constructing the items 
D)  testing the items

Question 15

When tests are used for purposes of_______ , it is necessary to develop a regression equation.

Accepted Answer

A)  predicting outcomes 
B)  validating a theory 
C)  content validation 
D)  estimating reliability

Question 16

The item-discrimination index can vary from

Accepted Answer

A)  0 to 100 
B)  -1.0 to +1.0 
C)  0.0 to +1.0 
D)  0.5 to +1.0

Question 17

The proportion of examinees in a large tryout sample who get a specific item correct is called

Accepted Answer

A)  item-difficulty index 
B)  item-reliability index 
C)  item-validity index 
D)  index of item discrimination

Question 18

The higher the ________, the more accurate the test is in predicting the criterion.

Accepted Answer

A)  validity coefficient 
B)  reliability coefficient 
C)  validity curve 
D)  reliability curve

Question 19

To help insure that a test contains the desired mixture of cognitive processes and content domains, test developers

Accepted Answer

A)  follow the guidelines specified by Binet 
B)  use factor analysis on the test items 
C)  use a table of specifications 
D)  always consult similar instruments before writing test items

Question 20

If an item such as "I drink a lot of water" was on a depression scale, the test likely employed the_______ scaling method

Accepted Answer

A)  empirical keying 
B)  Likert 
C)  absolute 
D)  rational

Exam 4: Validity and Test Development

To know how well each preliminary test item contributes to accurate prediction of the criterion, we would use

What concept is best summed up by the question, "Does use of this test result in better patient outcomes or more efficient delivery of services?"

It is common practice in test development that the prepublication version of a new instrument might contain ________the number of items desired on the final draft.

In order to investigate potential sex bias in a test item, we would examine an)

Which of the following scaling methods is considered the "gold standard"?

According to the functionalist perspective on test validity, a test is valid if

A construct is

Which scale construction method guarantees that all scale items correlate positively with each other and also with the total score for the scale?

In________ validity, test scores are used to estimate outcome measures obtained at a later date.

The index of item difficulty can vary from

A factor loading is actually(an) _____

A(n) _______scale has a conceptually meaningful zero point.

Factor loadings can vary between

The first step in test construction is

When tests are used for purposes of_______ , it is necessary to develop a regression equation.

The item-discrimination index can vary from

The proportion of examinees in a large tryout sample who get a specific item correct is called

The higher the ________, the more accurate the test is in predicting the criterion.

To help insure that a test contains the desired mixture of cognitive processes and content domains, test developers

If an item such as "I drink a lot of water" was on a depression scale, the test likely employed the_______ scaling method