Question 1

Identify and briefly explain the steps necessary to define the context of a test.

Accepted Answer

a. Specify the intended context - Is the measure a general measure across situations, or specific to a particular context?
b. Specify the relation to other constructs - In what ways is the construct different from related constructs?
c. Specify the dimensionality of the construct - How many dimensions?
d. Specify the weighting of various dimensions - In a multidimensional scale, is each dimension equally important? The number of items per dimension should reflect the relative weighting.

Question 2

When developing a measure utilizing a Likert-type rating scale, the specification of how many scale anchors will be included is part of determining ________.

Accepted Answer

A)  scale dimensionality 
B)  test length 
C)  item format 
D)  item difficulty 
A)  scale dimensionality 
B)  test length 
C)  item format 
D)  item difficulty C

Question 3

Thorough test specifications ________ the test development process.

Accepted Answer

A)  simplify 
B)  complicate 
C)  justify 
D)  eliminate 
A)  simplify 
B)  complicate 
C)  justify 
D)  eliminate A

Question 4

Consideration of the careful balance between practical concerns in test administration and psychometric properties of the measure will influence the developer's concern with ________.

Accepted Answer

A)  scale dimensionality 
B)  test length 
C)  item format 
D)  item difficulty 
A)  scale dimensionality 
B)  test length 
C)  item format 
D)  item difficulty

Question 5

Measures that assess several related components are referred to as ________.

Accepted Answer

A)  biased 
B)  complex 
C)  open-ended 
D)  multidimensional 
A)  biased 
B)  complex 
C)  open-ended 
D)  multidimensional

Question 6

When should test specification occur?

Accepted Answer

A)  As the first step in test development 
B)  At the time of item writing 
C)  Following initial item analysis 
D)  Immediately prior to the initial administration of the test 
A)  As the first step in test development 
B)  At the time of item writing 
C)  Following initial item analysis 
D)  Immediately prior to the initial administration of the test

Question 7

Identify 2 advantages and 2 disadvantages of using open-ended items.

Accepted Answer

Advantages include responses revealing t

Question 8

Explain the advantages of using a frame of reference tag in developing a personality scale.

Accepted Answer

Frame of reference tags refer to specifi

Question 9

Why is the identification of constructs related to the domain of the test an important step in the test development process?

Accepted Answer

Identifying similar constructs

Question 10

A primary disadvantage of using closed-ended items is the ________.

Accepted Answer

A)  difficulty in scoring responses 
B)  challenge in analyzing respondent data 
C)  inability of respondents to clarify their answers 
D)  expertise required for test administration 
A)  difficulty in scoring responses 
B)  challenge in analyzing respondent data 
C)  inability of respondents to clarify their answers 
D)  expertise required for test administration

Question 11

Test specification takes time and work. Why bother with this potentially lengthy process?

Accepted Answer

A test is only as good as the work put i

Question 12

If a test is multidimensional, the number of items developed to measure each dimension should be ________.

Accepted Answer

A)  equal 
B)  reflective of the relative weighting of each corresponding facet 
C)  as many as possible 
D)  no fewer than 5 per facet 
A)  equal 
B)  reflective of the relative weighting of each corresponding facet 
C)  as many as possible 
D)  no fewer than 5 per facet

Question 13

An employment interview is an example of a ________ performance test.

Accepted Answer

A)  maximal 
B)  hypothetical 
C)  typical 
D)  conditional 
A)  maximal 
B)  hypothetical 
C)  typical 
D)  conditional

Question 14

The abilities of the intended sample of test-takers would be most important in specifying ________ .

Accepted Answer

A)  the test domain 
B)  multidimensionality 
C)  test length 
D)  item difficulty 
A)  the test domain 
B)  multidimensionality 
C)  test length 
D)  item difficulty

Question 15

The most important step in test specification is ?________.

Accepted Answer

A)  determining whether the items will be closed-ended, open-ended, or both 
B)  defining the content domain of the test 
C)  deciding between individual vs. group administered tests 
D)  identifying the appropriate difficulty level of items on the test 
A)  determining whether the items will be closed-ended, open-ended, or both 
B)  defining the content domain of the test 
C)  deciding between individual vs. group administered tests 
D)  identifying the appropriate difficulty level of items on the test

Identify and briefly explain the steps necessary to define the context of a test.

When developing a measure utilizing a Likert-type rating scale, the specification of how many scale anchors will be included is part of determining ________.

Thorough test specifications ________ the test development process.

Consideration of the careful balance between practical concerns in test administration and psychometric properties of the measure will influence the developer's concern with ________.

Measures that assess several related components are referred to as ________.

When should test specification occur?

Identify 2 advantages and 2 disadvantages of using open-ended items.

Explain the advantages of using a frame of reference tag in developing a personality scale.

Why is the identification of constructs related to the domain of the test an important step in the test development process?

A primary disadvantage of using closed-ended items is the ________.

Test specification takes time and work. Why bother with this potentially lengthy process?

If a test is multidimensional, the number of items developed to measure each dimension should be ________.

An employment interview is an example of a ________ performance test.

The abilities of the intended sample of test-takers would be most important in specifying ________ .

The most important step in test specification is ?________.

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Developing Measures of Typical Performance

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Applications of Item Response Theory: Computer Adaptive Testing and Differential Item Functioning

Generalizability Theory

Filters

Exam 4: Test Preparation and Specification

Identify and briefly explain the steps necessary to define the context of a test.

When developing a measure utilizing a Likert-type rating scale, the specification of how many scale anchors will be included is part of determining ________.

Thorough test specifications ________ the test development process.

Consideration of the careful balance between practical concerns in test administration and psychometric properties of the measure will influence the developer's concern with ________.

Measures that assess several related components are referred to as ________.

When should test specification occur?

Identify 2 advantages and 2 disadvantages of using open-ended items.

Explain the advantages of using a frame of reference tag in developing a personality scale.

Why is the identification of constructs related to the domain of the test an important step in the test development process?

A primary disadvantage of using closed-ended items is the ________.

Test specification takes time and work. Why bother with this potentially lengthy process?

If a test is multidimensional, the number of items developed to measure each dimension should be ________.

An employment interview is an example of a ________ performance test.

The abilities of the intended sample of test-takers would be most important in specifying ________ .

The most important step in test specification is ?________.

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Developing Measures of Typical Performance

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Applications of Item Response Theory: Computer Adaptive Testing and Differential Item Functioning

Generalizability Theory

Filters