Question 1

In Guttman scaling

Accepted Answer

A)  testtakers are presented with a forced-choice format. 
B)  each item is completely independent of every other item and nothing can be concluded as the result of the endorsement of an item. 
C)  when one item is endorsed by a testtaker, the less extreme aspects of that item are also endorsed. 
D)  when more than one item tapping a particular content area is endorsed, the less extreme aspects of those items are also endorsed.

Question 2

As part of the process of test development,the term test revision BEST refers to the

Accepted Answer

A)  rewording, deletion, or development of new items. 
B)  development of a completely new test. 
C)  reprinting of a test after a previous edition has sold out. 
D)  Both a and b

Question 3

A test developer designs a test for the sole purpose of identifying the most highly skilled individuals among those tested.During the test revision stage of test development,the test developer will be particularly interested in

Accepted Answer

A)  item bias. 
B)  item discrimination. 
C)  item reliability. 
D)  item validity.

Question 4

In contrast to scaling methods that employ indirect estimation,scaling methods that employ direct estimation do not require:

Accepted Answer

A)  writing two sets of items for parallel forms. 
B)  the use of the method of equal-appearing intervals. 
C)  transforming testtaker responses into some other scale. 
D)  indirect methods to interpret testtaker responses.

Question 5

A student raises concern that a professor has given different grades to two essay answers that are very similar.From a psychometric perspective,the student is expressing concerns about

Accepted Answer

A)  criterion-related validity. 
B)  rater error. 
C)  test-retest reliability. 
D)  parallel forms reliability.

Question 6

Which of the following conditions may lead to the decision to revise a psychological or educational test?

Accepted Answer

A)  item content, including the vocabulary used in instructions and pictures, has become dated 
B)  test norms no longer represent the population for which the test is designed 
C)  reliability and validity of a test can be improved by a revision 
D)  All of these

Question 7

Scoring drift refers to

Accepted Answer

A)  the tendency of scorers to give higher scores to testtakers with certain characteristics (such as age and gender) that is similar to themselves. 
B)  differences between the typical scoring of an item during standardization and subsequent, more authoritative scoring of an item. 
C)  a gradual decline in inter-scorer reliability after 95% of the examinations have been scored due to scorer fatigue. 
D)  a flexible method of scoring test items for populations other than that of the standardization sample.

Question 8

One of the questions that the developer of a new test must answer is,"Should more than one form of the test be developed?" In answering this question,a primary consideration is

Accepted Answer

A)  development costs. 
B)  test content. 
C)  test reliability. 
D)  item discrimination.

Question 9

What is the value of the item-discrimination index for an item that all the students in the higher-scoring group answered correctly but that no one in the lower-scoring group answered correctly?

Accepted Answer

A)  -1 
B)  +1 
C)  .50 
D)  .25

Question 10

The best type of item yields an item-characteristic curve that

Accepted Answer

A)  has a positive slope. 
B)  has a negative slope. 
C)  is leptokurtic. 
D)  has few, if any, outliers.

Question 11

If an item-discrimination index is negative

Accepted Answer

A)  high scorers are more likely to have answered the item correctly than low scorers. 
B)  low scorers are more likely to have answered the item correctly than high scorers. 
C)  the alternate form of the test is probably not equivalent. 
D)  the computer scoring is in error because this index is not supposed to be negative.

Question 12

Having a large item pool available during test revision is

Accepted Answer

A)  a disadvantage due to the great expense of item development. 
B)  often a waste of time because many of the items are eventually deleted. 
C)  an advantage because poor items can be deleted in favor of the good items. 
D)  a great perk for test developers who are swimming enthusiasts.

Question 13

Which statement best describes the relationship between item difficulty and a "good" item?

Accepted Answer

A)  The difficulty level is not a factor in determining a "good" item. 
B)  An item with a high difficulty level is likely to be "good." 
C)  An item with a mid-range difficulty level is likely to be "good." 
D)  An item with a low difficulty level is likely to be "good."

Question 14

Which statement is TRUE of guessing?

Accepted Answer

A)  It occurs more often on achievement than personality tests. 
B)  It posts methodological problems for the testtaker. 
C)  Most testtakers guess based on little knowledge of the subject matter. 
D)  It poses methodological problems for the test developer.

Question 15

Item analysis is conducted to evaluate

Accepted Answer

A)  item reliability. 
B)  item validity. 
C)  item difficulty. 
D)  All of these

Question 16

One of the questions that the developer of a new test must answer is,"How will the test be administered?" The answer to this question may be

Accepted Answer

A)  the test will be individually administered. 
B)  the test will be group administered. 
C)  the test will be individually or group administered. 
D)  None of these

Question 17

Which is NOT a typical question that is raised and answered during the test conceptualization stage of test development?

Accepted Answer

A)  What is the objective of the test? 
B)  Is there a need for the test? 
C)  How valid are the items on the test? 
D)  What types of responses will be required of the testtaker?

Question 18

Which is an example of the selected-response item format?

Accepted Answer

A)  a multiple-choice item 
B)  a fill-in-the-blank item 
C)  Both a and b 
D)  None of these

Question 19

At the end-point in the process of creating an item bank,the final version of a test may take the form of an instrument

Accepted Answer

A)  suitable for computerized-adaptive testing. 
B)  that has all of the items "fixed." 
C)  Both a and b 
D)  None of these

Question 20

The idea for a new test may come from

Accepted Answer

A)  social need. 
B)  review of the available literature. 
C)  common sense appeal. 
D)  All of these

Exam 8: Test Development