Question 1

Schwarz (1999) posited that respondents to survey questions make assumptions about the ________meaning of each question.

Accepted Answer

A)  simple 
B)  logical 
C)  pragmatic 
D)  literal 
A)  simple 
B)  logical 
C)  pragmatic 
D)  literal C

Question 2

Inclusion of a "don't know" option on the response scale of an attitude survey would be most important when assessing ________.

Accepted Answer

A)  behaviors from the distant past 
B)  highly personal opinions 
C)  deviant behaviors 
D)  attitudes on topics respondents may have little knowledge of 
A)  behaviors from the distant past 
B)  highly personal opinions 
C)  deviant behaviors 
D)  attitudes on topics respondents may have little knowledge of D

Question 3

Compare and contrast the advantages and disadvantages of using selected vs. constructed response items when constructing a measure of typical performance.

Accepted Answer

When constructing a measure of typical performance, selected response items and constructed response items each have advantages and disadvantages. Constructed (i.e., free response) items allow respondents to provide any answer they choose. Respondents may use their own frame of reference for these items. Their responses will reveal their most salient thoughts. This also allows them to qualify their responses. However, when the constructed response requires a great deal of effort to respond, such as when they must submit written responses, the responses are likely to be brief, or participation may be low. Respondents may also provide information that is not relevant to the topic under investigations. Finally, constructed responses are difficult to categorize leading to challenges in coding, analyzing, and reporting the data.
Selected response items lead to easy data gathering, coding, and analysis. However, respondents cannot qualify their responses (though the authors of this book have seen participants try to do so by writing on scantron forms!). The presentation of response options may influence the responses provided by the respondents.

Question 4

Schuman and Presser (1996) found that about ________ percent of respondents will provide an opinion on a topic that they know nothing about if a "don't know" option is omitted from the item.

Accepted Answer

A)  5% 
B)  30% 
C)  50% 
D)  70% 
A)  5% 
B)  30% 
C)  50% 
D)  70%

Question 5

Under what conditions would it be appropriate to present survey respondents with a leading (or emotionally loaded) question?

Accepted Answer

While we should typically avoid leading

Question 6

The inclusion of reverse coded items in survey research is commonplace.

Accepted Answer

(a) Reverse coded items are items that a

Question 7

Compared to empirical test development, a test that was created using the rational test development process would likely result in ________.

Accepted Answer

A)  an initial pool of more items 
B)  a final measure consisting of more items 
C)  the use of an external criterion of interest to determine whether to retain items 
D)  retention only of items receiving endorsements from subject matter experts 
A)  an initial pool of more items 
B)  a final measure consisting of more items 
C)  the use of an external criterion of interest to determine whether to retain items 
D)  retention only of items receiving endorsements from subject matter experts

Question 8

The primary goal of the Total Design Method (TDM) of survey implementation is to increase the ________ of the survey.

Accepted Answer

A)  internal consistency reliability 
B)  criterion-related validity 
C)  response rate 
D)  overall quality 
A)  internal consistency reliability 
B)  criterion-related validity 
C)  response rate 
D)  overall quality

Question 9

________ is the first step in the development of a measure of typical performance.

Accepted Answer

A)  Item writing 
B)  Recruitment of SMEs 
C)  Comparison analysis 
D)  Test specification 
A)  Item writing 
B)  Recruitment of SMEs 
C)  Comparison analysis 
D)  Test specification

Question 10

Research has suggested that when provided a response scale, respondents to attitude surveys often view the scale midpoint as a(n) ________.

Accepted Answer

A)  complete lack of attitude 
B)  extreme attitude or amount 
C)  neutral point or typical amount 
D)  safe response regardless of their attitude 
A)  complete lack of attitude 
B)  extreme attitude or amount 
C)  neutral point or typical amount 
D)  safe response regardless of their attitude

Question 11

Explain why a think aloud study should be incorporated as part of the test development process.

Accepted Answer

In a think aloud study, a representative

Question 12

Applied to attitude surveys, acquiescence refers to the tendency to ________.

Accepted Answer

A)  respond to any item, even if the item is assessing a fictitious topic 
B)  agree with an attitude statement 
C)  agree to participate in attitude assessment, even for very little compensation 
D)  respond to items in a manner that will reflect positively on the individual 
A)  respond to any item, even if the item is assessing a fictitious topic 
B)  agree with an attitude statement 
C)  agree to participate in attitude assessment, even for very little compensation 
D)  respond to items in a manner that will reflect positively on the individual

Question 13

Schwarz (1999) argued that respondents follow rules of cooperative conversational conduct in responding to survey questions. What implications do such rules have on understanding survey responses?

Accepted Answer

Schwarz (1999) argues that survey respon

Question 14

A(n) ________ test would be an example of a typical performance measure.

Accepted Answer

A)  personality 
B)  work sample 
C)  educational achievement 
D)  job knowledge 
A)  personality 
B)  work sample 
C)  educational achievement 
D)  job knowledge

Question 15

An empirically derived measure would be expected to have lower ________ than a rationally derived measure.

Accepted Answer

A)  face validity 
B)  predictive criterion-related validity 
C)  concurrent criterion-related validity 
D)  test-retest reliability 
A)  face validity 
B)  predictive criterion-related validity 
C)  concurrent criterion-related validity 
D)  test-retest reliability

Schwarz (1999) posited that respondents to survey questions make assumptions about the ________meaning of each question.

Inclusion of a "don't know" option on the response scale of an attitude survey would be most important when assessing ________.

Compare and contrast the advantages and disadvantages of using selected vs. constructed response items when constructing a measure of typical performance.

Schuman and Presser (1996) found that about ________ percent of respondents will provide an opinion on a topic that they know nothing about if a "don't know" option is omitted from the item.

Under what conditions would it be appropriate to present survey respondents with a leading (or emotionally loaded) question?

The inclusion of reverse coded items in survey research is commonplace.

Compared to empirical test development, a test that was created using the rational test development process would likely result in ________.

The primary goal of the Total Design Method (TDM) of survey implementation is to increase the ________ of the survey.

________ is the first step in the development of a measure of typical performance.

Research has suggested that when provided a response scale, respondents to attitude surveys often view the scale midpoint as a(n) ________.

Explain why a think aloud study should be incorporated as part of the test development process.

Applied to attitude surveys, acquiescence refers to the tendency to ________.

Schwarz (1999) argued that respondents follow rules of cooperative conversational conduct in responding to survey questions. What implications do such rules have on understanding survey responses?

A(n) ________ test would be an example of a typical performance measure.

An empirically derived measure would be expected to have lower ________ than a rationally derived measure.

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Test Preparation and Specification

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Applications of Item Response Theory: Computer Adaptive Testing and Differential Item Functioning

Generalizability Theory

Filters

Exam 15: Developing Measures of Typical Performance

Schwarz (1999) posited that respondents to survey questions make assumptions about the ________meaning of each question.

Inclusion of a "don't know" option on the response scale of an attitude survey would be most important when assessing ________.

Compare and contrast the advantages and disadvantages of using selected vs. constructed response items when constructing a measure of typical performance.

Schuman and Presser (1996) found that about ________ percent of respondents will provide an opinion on a topic that they know nothing about if a "don't know" option is omitted from the item.

Under what conditions would it be appropriate to present survey respondents with a leading (or emotionally loaded) question?

The inclusion of reverse coded items in survey research is commonplace.

Compared to empirical test development, a test that was created using the rational test development process would likely result in ________.

The primary goal of the Total Design Method (TDM) of survey implementation is to increase the ________ of the survey.

________ is the first step in the development of a measure of typical performance.

Research has suggested that when provided a response scale, respondents to attitude surveys often view the scale midpoint as a(n) ________.

Explain why a think aloud study should be incorporated as part of the test development process.

Applied to attitude surveys, acquiescence refers to the tendency to ________.

Schwarz (1999) argued that respondents follow rules of cooperative conversational conduct in responding to survey questions. What implications do such rules have on understanding survey responses?

A(n) ________ test would be an example of a typical performance measure.

An empirically derived measure would be expected to have lower ________ than a rationally derived measure.

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Test Preparation and Specification

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Applications of Item Response Theory: Computer Adaptive Testing and Differential Item Functioning

Generalizability Theory

Filters