Question 1

You want your final test to have 50 items. What recommendation does the text make regarding the number of items to be prepared for item tryout?

Accepted Answer

A)  55-60 
B)  75 
C)  100-150 
D)  500

Question 2

The statement of purpose for a test usually includes the variable or trait to be measured and the -

Accepted Answer

A)  name of the author 
B)  intended test length 
C)  cost of the test 
D)  target audience

Question 3

The term "item difficulty" refers to ___.

Accepted Answer

A)  percent of examinees who got the item wrong 
B)  percent of examinees who got the item right 
C)  reading level of the words in the item stem 
D)  reading level of the words in the item options

Question 4

In a three parameter model, the ICC is determined by the ___.

Accepted Answer

A)  item difficulty, validity, and guessing parameters 
B)  item discrimination, reliability, and difficulty parameters 
C)  item difficulty, discrimination, and guessing parameters 
D)  item discrimination, validity, and reliability parameters

Question 5

In item response theory, we usually represent the relationship between performance on an item and status on the trait of interest in terms of ___.

Accepted Answer

A)  an item p-value 
B)  a Pearson correlation 
C)  an item characteristic curve 
D)  the reading level of the item

Question 6

Item characteristic curves usually have the shape of what letter?

Accepted Answer

A)  H 
B)  L 
C)  C 
D)  S

Question 7

The text identifies a number of "preliminary design" issues to be considered when building a test? Which of these is NOT one of them?

Accepted Answer

A)  length 
B)  number of scores 
C)  item format 
D)  defining the purpose

Question 8

Which of the following is the first phase in item analysis?

Accepted Answer

A)  item selection 
B)  statistical analysis 
C)  item discrimination 
D)  item tryout

Question 9

In the early 20th century, multiple-choice (MC) items became preferred to essay items because the MC items ___.

Accepted Answer

A)  were easier to construct 
B)  yielded better reliability 
C)  had better validity 
D)  were easier to norm

Question 10

The Likert format is most often be used with _____ measures.

Accepted Answer

A)  vocational 
B)  intelligence 
C)  achievement 
D)  attitude

Question 11

An instructor scores an essay by assigning a single score representing the overall quality of the essay. This is an application of __________ scoring.

Accepted Answer

A)  analytical 
B)  holistic 
C)  objective 
D)  point-system

Question 12

In the language of testing, the question to which an examinee responds is often called the ___.

Accepted Answer

A)  format 
B)  stimulus 
C)  norm 
D)  protocol

Question 13

What is the relationship between the mean score on a test and the item p-values? The mean score is ___.

Accepted Answer

A)  independent of the p-values 
B)  the sum of the p-values 
C)  the average p-value minus the average discrimination value 
D)  the average p-value plus the average discrimination value

Question 14

The average difficulty level of the test is a direct function of the ___.

Accepted Answer

A)  ability of the test-takers 
B)  size of testing sample 
C)  number of test items 
D)  specific item p-values

Question 15

Which type of reliability is most easily determined as part of the standardization program for a test?

Accepted Answer

A)  internal consistency 
B)  test-retest 
C)  alternate form 
D)  inter-scorer

Question 16

The value of D can be maximized by having the p-value = _____.

Accepted Answer

A)  1.00 
B)  0.00 
C)  -1.00 
D)  .50

Question 17

As a general rule, when selecting items for a final test based on item analysis statistics, we want items with _________ discrimination indices.

Accepted Answer

A)  high 
B)  moderate 
C)  low 
D)  negative

Question 18

The use of sophisticated computer programs that simulate the application of human judgment for scoring free-response items is called ___.

Accepted Answer

A)  machine-scoring 
B)  computer scanning 
C)  judgmental scoring 
D)  automated scoring

Question 19

Which type of item is used to measure attitudes, with responses to items along a scale of Strongly Agree to Strongly Disagree?

Accepted Answer

A)  Semantic differential 
B)  Graphic rating 
C)  Thurstone 
D)  Likert

Question 20

The item characteristic curve (ICC) relates status on the trait underlying the scale (defined in terms of F1F1F1S1F1F1F10) to ___.

Accepted Answer

A)  the p-value of the item 
B)  the D value of the item 
C)  overall ability of the sample 
D)  probability of passing the item

Exam 6: Test Development and Item Analysis