Deck 6: Item Development

Question 1

___________ require examinees to complete a process or produce a project in a real-life simulation.

A)Projective tests
B)Performance assessments
C)Selected response test
D)Multi-trait/multi-method tasks

Answer 1

Performance assessments

Question 2

A fill-in-the-blank question is a ___________ item.

A)constructed-response
B)selected-response
C)typical-response
D)objective-response

Answer 2

constructed-response

Question 3

Which of the following is NOT a guideline for developing true-false items?

A)Include more than one idea in the statement.
B)Avoid using specific determiners such as all,none,or never.
C)Ensure that true and false statements are approximately the same length.
D)Avoid using moderate determiners such as sometimes and usually.

Answer 3

Include more than one idea in the statement.

Question 4

How many distracters is it recommended that one provide for multiple choice items?

A)2
B)2 to 6
C)3 to 5
D)4

Question 5

Which of the following formats is a selected-response format?

A)Multiple-choice
B)True-false
C)Matching
D)All of above

Question 6

__________ are reported as the most popular selected-response items.

A)Essays
B)Matching
C)Multiple-choice
D)True-false

Question 7

What would be the recommended multiple-choice format for the stem: 'What does 10x10 equal?'

A)Best answer
B)Correct answer
C)Closed negative
D)Double negative

Question 8

An oral examination,scored by examiners who use a manual and rubric,is an example of _________ scoring.

A)objective
B)subjective
C)projective
D)validity

Question 9

In order to determine the number of items to include on a test,one should consider the:

A)age of examinees.
B)purpose of test.
C)types of items.
D)type of test.
E)All of the above

Question 10

What is a strength of selected-response items?

A)Selected-response items are easy and quick to write.
B)Selected-response items can be used to assess all constructs.
C)Selected-response items can be objectively scored.

Question 11

Which multiple-choice answer format requires the examinee to make subtle distinctions among distracters?

A)Best answer
B)Correct answer
C)Closed negative
D)Double negative

Question 12

Including more selected-response and other time-efficient items can:

A)enhance the sampling of the content domain and increase reliability.
B)enhance the sampling of the content domain and decrease reliability.
C)introduce construct irrelevant variance.
D)decrease validity.

Question 13

When developing maximum performance tests,it is best to arrange the items:

A)from easiest to hardest.
B)from hardest to easiest.
C)in the order the information was taught.
D)randomly.

Question 14

When writing multiple-choice items,one advantage to the ______________ is that it may present the problem in a more concise manner.

A)direct-question format
B)incomplete sentence format
C)indirect question format

Question 15

When developing matching items,one should keep the lists as ___________ as possible.

A)heterogeneous
B)homogeneous
C)sequential
D)simultaneous

Question 16

What is a strength of true-false items?

A)They can measure very complex objectives.
B)Examinees can answer many items in a short period of time.
C)They are not vulnerable to guessing.

Question 17

When writing true-false items,one should include approximately _________ true and ________ false.

A)30%; 70%
B)50%; 50%
C)70%; 30%

Question 18

A strength of constructed-response items is that they:

A)eliminate random guessing.
B)produce highly reliable scores
C)can be quickly completed by examinees.
D)eliminate "feigning."

Question 19

General guidelines for writing test items include:

A)the frequent use of negative statements.
B)the use of complex,compound sentences to challenge the examinees.
C)the avoidance of inadvertent cues to the answers.
D)arranging items in a non-systematic manner.

Question 20

You are creating a test designed to assess a flute player's ability.Which format would assess this domain most effectively?

A)Performance assessment
B)Matching
C)Selected-response
D)True-false

Question 21

Examinees tend to overuse the neutral response when Likert items use ________ and may omit items when Likert items use __________.

A)an odd number of options; an even number of options
B)an even number of options; an odd number of options
C)homogenous options; heterogeneous options
D)heterogeneous options; homogenous options

Question 22

_________ scoring rubrics identify different aspects or dimensions,each of which is scored separately.

A)Analytic
B)Holistic
C)Sequential
D)Simultaneous

Question 23

With a _______ rubric,a single grade is assigned based on the overall quality of the response.

A)analytic
B)holistic
C)reliable
D)structured

Question 24

What item format is commonly used in both maximum performance tests and typical response tests?

A)Constructed-response
B)Multiple-choice
C)Rating scales
D)True-false

Question 25

One way to increase the reliability of short-answer items is to:

A)give partial credit.
B)provide a word bank.
C)use the incomplete sentence format with multiple blanks.
D)use a scoring rubric.

Question 26

Which of the following items are difficult to score in a reliable manner and subject to feigning?

A)Constructed-response
B)True-false
C)Selected-response
D)Forced choice

Question 27

Guttman scales provide which scale of measurement?

A)Nominal
B)Ordinal
C)Interval
D)Ratio

Question 28

Distracters are:

A)rubric grading criteria.
B)the incorrect response on a multiple-choice items.
C)words inserted in an item intended to "trick" the examinee.
D)unintentional clues to the correct answer.

Question 29

Which format is the most popular when assessing attitudes?

A)Constructed-response
B)Forced choice
C)Frequency scales
D)Likert items
E)True-false

Question 30

Which assessment would best use a Thurstone scale?

A)Constructed-response test
B)Maximum performance test
C)Speed test
D)Power test
E)Typical response test

Question 31

According to a study by Powers and Kaufman (2002)regarding the relationship between performance on the GRE and creativity,depth,and quickness,what were the findings?

A)There is substantial evidence that creative,deep-thinkers are penalized by multiple-choice items.
B)There was no evidence that creative,deep-thinkers are penalized by multiple-choice items.
C)There was a significant negative correlation between GRE scores and depth.
D)There was a significant negative correlation between GRE scores and creativity.

Question 32

_________ are a form of performance assessment that involves the systematic collection and evaluation of work products.

A)Rubrics
B)Virtual exams
C)Practical assessments
D)Portfolio assessments

Question 33

For typical-response tests,which format provides more information per item and thus can increase the range and reliability of scores?

A)Constructed-response
B)Frequency ratings
C)True-false
D)Matching