Question 1

Reliability relates to test ___________.

Accepted Answer

A) items 
B) length 
C) scores 
D) constructs

Question 2

Item difficulty indexes on mastery tests tend to be ________ item difficulty indexes on tests designed to produce norm-referenced scores.

Accepted Answer

A) larger than 
B) lower than 
C) equal to

Question 3

A general recommendation is to use items with p values that have a range of approximately _________ around the optimal value.

Accepted Answer

A) 0.05 
B) 0.10 
C) 0.15 
D) 0.20 
E) 0.25

Question 4

Which of the following statements regarding p values is correct?

Accepted Answer

A) They can range from -1.0 to 1.0. 
B) Items with a high p value are more difficult. 
C) Items with a low p value are more difficult. 
D) Items with a p value of 1.0 were answered incorrectly by all students.

Question 5

On an Item Characteristic Curve,the point halfway between the lower and upper asymptotes is referred to as the __________ and represents the difficulty of the item.

Accepted Answer

A) medial apex 
B) modal beta 
C) beta index 
D) inflection point

Question 6

While the item difficulty index is only applicable for _____________,the percent endorsement statistic can be calculated for ____________.

Accepted Answer

A) maximum performance tests; constructed-response tests 
B) maximum performance tests; typical-response tests 
C) typical-response tests; constructed-response tests 
D) typical-response tests; maximum performance tests

Question 7

On a maximum performance test administered to 100 students,60 students correctly answer item #4.The item difficulty index equals:

Accepted Answer

A) 0.40 
B) 0.60 
C) 40 
D) 60

Question 8

An Item Characteristic Curve is a graph with ____________ reflected on the horizontal axis and ______________reflected on the vertical axis.

Accepted Answer

A) ability; probability of a correct response 
B) probability of a correct response; ability 
C) ability; probability of an incorrect response 
D) probability of an incorrect response; ability

Question 9

What is the approximate optimal Item Difficulty Index for a multiple-choice item with 4 choices?

Accepted Answer

A) 0.0 
B) 0.25 
C) 0.50 
D) 0.75 
E) 1.0

Question 10

The one-parameter IRT model assumes that items only differ in:

Accepted Answer

A) the chance of a random correct answer. 
B) difficulty. 
C) discrimination. 
D) scree point.

Question 11

Items with a difficulty index of _______ do not contribute to the measurement characteristics of a test.

Accepted Answer

A) 0.25 
B) 0.50 
C) 0.75 
D) 1.0

Question 12

Your employer wants a test that will help him to select the upper 30% of employees to consider for new positions.It would be beneficial for the item difficulty index to average around:

Accepted Answer

A) 0.20 
B) 0.30 
C) 0.70 
D) 0.80 
E) 0.90

Question 13

A test analysis is displayed below.Based on this information,what is the most obvious problem? $p = 0.40  D = 0.13$
$\begin{array}{lcccc}
&\quad\quad\quad\text {Options}\
\text { Item \#3 } & \mathrm{A} & \mathrm{B} & \mathrm{C}^{*} & \mathrm{D} \
\hline \text { Number in top group } &6 & 1 & 1 & 7 \
\
\text { Number in bottom group } & 2 & 4 & 4 & 5 \
\hline \text { *correct answer } & & & 
\end{array}$

Accepted Answer

A) All distracters are performing well. 
B) Distracter A displays positive discrimination and should be revised. 
C) Distracter B displays positive discrimination and should be revised. 
D) No problem,retain the item as is.

Question 14

A test item with p = .80 and D = .40 is:

Accepted Answer

A) relatively easy and discriminates well. 
B) relatively easy and does not discriminate well. 
C) relatively difficult and does discriminate well. 
D) relatively difficult and does not discriminate well. 
E) of intermediate difficulty and does not discriminate well.

Question 15

A test item with p = .50 and D = .40 is:

Accepted Answer

A) relatively easy and discriminates well 
B) relatively easy and does not discriminate well. 
C) relatively difficult and does discriminate well. 
D) relatively difficult and does not discriminate well. 
E) of intermediate difficulty and discriminates well.

Question 16

For item 21,pT is 0.80 and pB is 0.30.What is the value of D for this item?

Accepted Answer

A) 0.20 
B) 0.25 
C) 0.50 
D) 0.70

Question 17

As a general rule,the authors of the chapter suggest that items with D values greater than ______ are acceptable.

Accepted Answer

A) 0.25 
B) 0.30 
C) 0.50 
D) 0.70

Exam 7: Item Analysis: Methods for Fitting the Right Items to the Right Test