Deck 15: Developing Measures of Typical Performance

Question 1

A(n) ________ test would be an example of a typical performance measure.

A) personality
B) work sample
C) educational achievement
D) job knowledge

Answer 1

A

Question 2

Schwarz (1999) posited that respondents to survey questions make assumptions about the ________meaning of each question.

A) simple
B) logical
C) pragmatic
D) literal

Answer 2

C

Question 3

Schuman and Presser (1996) found that about ________ percent of respondents will provide an opinion on a topic that they know nothing about if a "don't know" option is omitted from the item.

A) 5%
B) 30%
C) 50%
D) 70%

Answer 3

B

Question 4

Applied to attitude surveys, acquiescence refers to the tendency to ________.

A) respond to any item, even if the item is assessing a fictitious topic
B) agree with an attitude statement
C) agree to participate in attitude assessment, even for very little compensation
D) respond to items in a manner that will reflect positively on the individual

Question 5

Research has suggested that when provided a response scale, respondents to attitude surveys often view the scale midpoint as a(n) ________.

A) complete lack of attitude
B) extreme attitude or amount
C) neutral point or typical amount
D) safe response regardless of their attitude

Question 6

Inclusion of a "don't know" option on the response scale of an attitude survey would be most important when assessing ________.

A) behaviors from the distant past
B) highly personal opinions
C) deviant behaviors
D) attitudes on topics respondents may have little knowledge of

Question 7

Compared to empirical test development, a test that was created using the rational test development process would likely result in ________.

A) an initial pool of more items
B) a final measure consisting of more items
C) the use of an external criterion of interest to determine whether to retain items
D) retention only of items receiving endorsements from subject matter experts

Question 8

An empirically derived measure would be expected to have lower ________ than a rationally derived measure.

A) face validity
B) predictive criterion-related validity
C) concurrent criterion-related validity
D) test-retest reliability

Question 9

The primary goal of the Total Design Method (TDM) of survey implementation is to increase the ________ of the survey.

A) internal consistency reliability
B) criterion-related validity
C) response rate
D) overall quality

Question 10

________ is the first step in the development of a measure of typical performance.

A) Item writing
B) Recruitment of SMEs
C) Comparison analysis
D) Test specification

Question 11

Compare and contrast the advantages and disadvantages of using selected vs. constructed response items when constructing a measure of typical performance.

Question 12

Schwarz (1999) argued that respondents follow rules of cooperative conversational conduct in responding to survey questions. What implications do such rules have on understanding survey responses?

Question 13

The inclusion of reverse coded items in survey research is commonplace.

Question 14

Under what conditions would it be appropriate to present survey respondents with a leading (or emotionally loaded) question?

Question 15

Explain why a think aloud study should be incorporated as part of the test development process.