Deck 4: Test Preparation and Specification

Question 1

The most important step in test specification is ?________.

A) determining whether the items will be closed-ended, open-ended, or both
B) defining the content domain of the test
C) deciding between individual vs. group administered tests
D) identifying the appropriate difficulty level of items on the test

Answer 1

B

Question 2

An employment interview is an example of a ________ performance test.

A) maximal
B) hypothetical
C) typical
D) conditional

Answer 2

A

Question 3

Thorough test specifications ________ the test development process.

A) simplify
B) complicate
C) justify
D) eliminate

Answer 3

A

Question 4

Measures that assess several related components are referred to as ________.

A) biased
B) complex
C) open-ended
D) multidimensional

Question 5

When developing a measure utilizing a Likert-type rating scale, the specification of how many scale anchors will be included is part of determining ________.

A) scale dimensionality
B) test length
C) item format
D) item difficulty

Question 6

Consideration of the careful balance between practical concerns in test administration and psychometric properties of the measure will influence the developer's concern with ________.

A) scale dimensionality
B) test length
C) item format
D) item difficulty

Question 7

If a test is multidimensional, the number of items developed to measure each dimension should be ________.

A) equal
B) reflective of the relative weighting of each corresponding facet
C) as many as possible
D) no fewer than 5 per facet

Question 8

The abilities of the intended sample of test-takers would be most important in specifying ________ .

A) the test domain
B) multidimensionality
C) test length
D) item difficulty

Question 9

When should test specification occur?

A) As the first step in test development
B) At the time of item writing
C) Following initial item analysis
D) Immediately prior to the initial administration of the test

Question 10

A primary disadvantage of using closed-ended items is the ________.

A) difficulty in scoring responses
B) challenge in analyzing respondent data
C) inability of respondents to clarify their answers
D) expertise required for test administration

Question 11

Why is the identification of constructs related to the domain of the test an important step in the test development process?

Question 12

Identify 2 advantages and 2 disadvantages of using open-ended items.

Question 13

Explain the advantages of using a frame of reference tag in developing a personality scale.

Question 14

Identify and briefly explain the steps necessary to define the context of a test.

Question 15

Test specification takes time and work. Why bother with this potentially lengthy process?