Question 1

The optimal level of item difficulty is MOST typically

Accepted Answer

A)  .5 
B)  the midpoint between 1.0 and the chance of success by random guessing. 
C)  .25. 
D)  the midpoint between 0 and the chance of success by random guessing.

Question 2

The item-validity index is key in determining

Accepted Answer

A)  construct validity. 
B)  criterion-related validity. 
C)  content validity. 
D)  All of these

Question 3

A good item on a norm-referenced achievement test is an item that

Accepted Answer

A)  demonstrates that the testtaker has met certain pre-specified criteria. 
B)  high scorers respond to correctly while low scorer respond to incorrectly. 
C)  both high and low scorers respond to correctly. 
D)  low scorers seek clarification regarding the meaning of the question.

Question 4

A test item written in a multiple-choice format has three elements.Which of the following is NOT one of those elements?

Accepted Answer

A)  foil 
B)  stem 
C)  leaf 
D)  correct option

Question 5

In his article entitled "A Method of Scaling Psychological and Educational Tests," L.L.Thurstone introduced absolute scaling which was a

Accepted Answer

A)  procedure for obtaining a measure of item validity. 
B)  procedure for obtaining a measure of item difficulty. 
C)  procedure for deriving equal-appearing intervals. 
D)  procedure for divining item reliability.

Question 6

An anchor protocol is

Accepted Answer

A)  a previously developed test with known validity that can be used as a comparison for newly developed tests. 
B)  a statistical procedure in which weights are assigned to each item of a model test to maximize predictive validity. 
C)  a list of guidelines for a standardized test used to ensure that all testtakers are similar in key ways to the population of the original standardization sample. 
D)  a model for scoring and a mechanism for resolving scoring discrepancies.

Question 7

A well-written true-false item

Accepted Answer

A)  includes multiple ideas. 
B)  has a correct response that is either true or false, and not subject to debate. 
C)  typically contains irrelevant information as a distracter. 
D)  Both a and b

Question 8

An individually administered designed for use with elementary-school-age student is in the test tryout stage of test development.For the purposes of the tryout,this test should be administered

Accepted Answer

A)  as a group test to as many classes as possible in an elementary school. 
B)  individually to high school students for exploratory purposes. 
C)  individually to elementary-school-age students in an environment that simulates the way that the final version of the test will be administered. 
D)  to experts in elementary school education to ensure that the items are appropriate for elementary school-aged children.

Question 9

When testing is conducted by means of a computer within a CAT context,it means that

Accepted Answer

A)  a testtaker's response to one item may automatically trigger what item will be presented next. 
B)  testing may be terminated based on some pre-set number of consecutive item failures. 
C)  testing may be terminated based on some pre-set, maximum number of items being administered. 
D)  All of these

Question 10

Instruments that contain items that function differentially

Accepted Answer

A)  may have reduced validity. 
B)  may have inflated reliability. 
C)  are last to be banked in an item bank. 
D)  are informally referred to as "DIFFED"

Question 11

In creating a test designed to measure personality constructs,the test developer's first step would BEST be to

Accepted Answer

A)  determine which items would lead to socially desirable responses. 
B)  create a large pool of potential items. 
C)  define the construct or constructs being measured. 
D)  select a representative sample of testtakers for test tryout

Question 12

On a particular test,men and women tend to have the same total score.Men and women do,however,tend to exhibit different response patterns to specific items.A reasonable conclusion is that the test is:

Accepted Answer

A)  unreliable. 
B)  invalid. 
C)  biased. 
D)  patently unfair.

Question 13

The Rokeach values measure involves presenting the subject with index cards,on each of which a single value is listed.Testtakers are asked to place the cards in order of their own concern about each of the values.This procedure BEST exemplifies

Accepted Answer

A)  multidimensional scaling. 
B)  Likert scaling. 
C)  comparative scaling. 
D)  best value scaling.

Question 14

If all raw scores on a test are to be converted to scores that range only from 1 to 9,the resulting scale is referred to as this type of scale:

Accepted Answer

A)  a unidimensional scale 
B)  a stanine scale 
C)  a multidimensional scale 
D)  None of these

Question 15

A test manual for a commercially prepared test should ideally include

Accepted Answer

A)  a description of the test development procedures used. 
B)  test-retest reliability data. 
C)  internal-consistency reliability data. 
D)  All of these

Question 16

A student makes the following complaint after taking an exam: "I spent all night studying Chapter 7 and there wasn't even one test question from that chapter!" From a psychometric perspective,this student is concerned about the exam's

Accepted Answer

A)  error variance. 
B)  test-retest reliability. 
C)  rater error. 
D)  None of these

Question 17

The higher the item-reliability index,

Accepted Answer

A)  the higher the internal consistency of the test. 
B)  the lower the internal consistency of the test. 
C)  the more likely the testtaker is to miss the item. 
D)  the more likely the test developer is to eliminate the item.

Question 18

To increase the precision of a test,test developers may have to

Accepted Answer

A)  increase the number of items. 
B)  increase the number of response options. 
C)  Both a and b 
D)  None of these

Question 19

Criterion-referenced testing and assessment is most typically employed in

Accepted Answer

A)  licensing for occupations and professions. 
B)  the diagnosis of reading difficulties. 
C)  competition for scholarships. 
D)  in situations where the criteria required for success are vague.

Question 20

If 100 people take a test and 20 of those testtakers answer a particular item correctly,then the p value of the item is

Accepted Answer

A)  .25. 
B)  .20. 
C)  .40. 
D)  .04.

Exam 8: Test Development