Question 1

In which circumstances, would you recommend Computerized Adaptive Testing to be used?

Accepted Answer

There would need to be a large volume of testing to justify the expense of CAT, and so an organization that tests only a few people on an irregular basis might not be a good candidate for CAT. In addition, without a large number of people taking the test, it will be hard to get a large enough sample to estimate parameters with accuracy. Second, if there is a wide range of test takers who will be taking the test it may be important to use a CAT so that individual tests can be tailored to the diverse range of test takers. Third, if test taker time needs to be minimized, the efficiency of CAT will be viewed as an important asset. Finally, if test security is paramount, the increased security due to CAT can be a big asset.

Question 2

Computerized adaptive tests are going to be most useful when _____________.

Accepted Answer

A)  item banks are large 
B)  there are items that span the theta range 
C)  items in the bank are discriminating 
D)  all of the above 
A)  item banks are large 
B)  there are items that span the theta range 
C)  items in the bank are discriminating 
D)  all of the above D

Question 3

If the discrimination parameters differ across groups in a differential item functioning (DIF) study, which of the following types of DIF would be exhibited?

Accepted Answer

A)  uniform 
B)  nonuniform 
C)  single-group 
D)  multi-group 
A)  uniform 
B)  nonuniform 
C)  single-group 
D)  multi-group B

Question 4

When paper and pencil based tests are transferred to computer without any modification, Shultz, Whitney, and Zickar (2021) refer to them as ___________ tests.

Accepted Answer

A)  computer-adaptive 
B)  electronically-delivered 
C)  digitally-administered 
D)  computer-based 
A)  computer-adaptive 
B)  electronically-delivered 
C)  digitally-administered 
D)  computer-based

Question 5

Which of the following is a reason why some smaller companies may choose not to use computerized adaptive testing?

Accepted Answer

A)  IRT models are not tenable 
B)  legal defensibility 
C)  requires a large number of test takers to calibrate 
D)  test takers may rebel against adaptive tests 
A)  IRT models are not tenable 
B)  legal defensibility 
C)  requires a large number of test takers to calibrate 
D)  test takers may rebel against adaptive tests

Question 6

In a computer adaptive test, the first item administered usually should have a __________?

Accepted Answer

A)  Discrimination close to one 
B)  Difficulty close to zero 
C)  Difficulty close to -1.0 
D)  Discrimination closer to zero 
A)  Discrimination close to one 
B)  Difficulty close to zero 
C)  Difficulty close to -1.0 
D)  Discrimination closer to zero

Question 7

Suppose you are conducting a differential item functioning analysis to see if women respond differentially to items that were originally developed on a sample of men. In this example, (using IRT terms) women would be the ________ group.

Accepted Answer

A)  referent 
B)  baseline 
C)  comparison 
D)  focal 
A)  referent 
B)  baseline 
C)  comparison 
D)  focal

Question 8

Shultz, Whitney, and Zickar (2021) mention which of the following as a common problem in differential item functioning studies?

Accepted Answer

A)  Hard to get a large enough sample for the minority group 
B)  Parameters often vary randomly across populations 
C)  It is hard to determine which IRT model to use 
D)  Lack of local independence 
A)  Hard to get a large enough sample for the minority group 
B)  Parameters often vary randomly across populations 
C)  It is hard to determine which IRT model to use 
D)  Lack of local independence

Question 9

What are the major advantages of CAT administration over traditional paper-and-pencil test administration?

Accepted Answer

There are several advantages that should

Question 10

What are strengths and limitations of the IRT-based approach to differential item functioning?

Accepted Answer

The IRT approaches to differential item

Question 11

Which of the following concepts in computerized adaptive language relates to test security?

Accepted Answer

A)  item exposure 
B)  item difficulty 
C)  item selection randomization 
D)  item discrimination 
A)  item exposure 
B)  item difficulty 
C)  item selection randomization 
D)  item discrimination

Question 12

In IRT, what is the technique used to see if items work the same across different populations?

Accepted Answer

A)  differential item functioning 
B)  measurement nonequivalence 
C)  item adaptive functioning 
D)  Mantel-Hansel 
A)  differential item functioning 
B)  measurement nonequivalence 
C)  item adaptive functioning 
D)  Mantel-Hansel

Question 13

If you are interested in item bias, please explain the various techniques that can be used to understand it.

Accepted Answer

There are several non-IRT approaches tha

Question 14

Which of the following statistical techniques is mentioned by Shultz, Whitney, and Zickar (2021) as a useful technique in understanding item bias?

Accepted Answer

A)  canonical correlation 
B)  logistic regression 
C)  exploratory factor analysis 
D)  discriminant function analysis 
A)  canonical correlation 
B)  logistic regression 
C)  exploratory factor analysis 
D)  discriminant function analysis

Question 15

What are key potential challenges with using Computerized Adaptive Testing?

Accepted Answer

CAT requires the use of item response th

In which circumstances, would you recommend Computerized Adaptive Testing to be used?

Computerized adaptive tests are going to be most useful when _____________.

If the discrimination parameters differ across groups in a differential item functioning (DIF) study, which of the following types of DIF would be exhibited?

When paper and pencil based tests are transferred to computer without any modification, Shultz, Whitney, and Zickar (2021) refer to them as ___________ tests.

Which of the following is a reason why some smaller companies may choose not to use computerized adaptive testing?

In a computer adaptive test, the first item administered usually should have a __________?

Suppose you are conducting a differential item functioning analysis to see if women respond differentially to items that were originally developed on a sample of men. In this example, (using IRT terms) women would be the ________ group.

Shultz, Whitney, and Zickar (2021) mention which of the following as a common problem in differential item functioning studies?

What are the major advantages of CAT administration over traditional paper-and-pencil test administration?

What are strengths and limitations of the IRT-based approach to differential item functioning?

Which of the following concepts in computerized adaptive language relates to test security?

In IRT, what is the technique used to see if items work the same across different populations?

If you are interested in item bias, please explain the various techniques that can be used to understand it.

Which of the following statistical techniques is mentioned by Shultz, Whitney, and Zickar (2021) as a useful technique in understanding item bias?

What are key potential challenges with using Computerized Adaptive Testing?

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Test Preparation and Specification

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Developing Measures of Typical Performance

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Generalizability Theory

Filters

Exam 21: Applications of Item Response Theory: Computer Adaptive Testing and Differential Item Functioning

In which circumstances, would you recommend Computerized Adaptive Testing to be used?

Computerized adaptive tests are going to be most useful when _____________.

If the discrimination parameters differ across groups in a differential item functioning (DIF) study, which of the following types of DIF would be exhibited?

When paper and pencil based tests are transferred to computer without any modification, Shultz, Whitney, and Zickar (2021) refer to them as ___________ tests.

Which of the following is a reason why some smaller companies may choose not to use computerized adaptive testing?

In a computer adaptive test, the first item administered usually should have a __________?

Suppose you are conducting a differential item functioning analysis to see if women respond differentially to items that were originally developed on a sample of men. In this example, (using IRT terms) women would be the ________ group.

Shultz, Whitney, and Zickar (2021) mention which of the following as a common problem in differential item functioning studies?

What are the major advantages of CAT administration over traditional paper-and-pencil test administration?

What are strengths and limitations of the IRT-based approach to differential item functioning?

Which of the following concepts in computerized adaptive language relates to test security?

In IRT, what is the technique used to see if items work the same across different populations?

If you are interested in item bias, please explain the various techniques that can be used to understand it.

Which of the following statistical techniques is mentioned by Shultz, Whitney, and Zickar (2021) as a useful technique in understanding item bias?

What are key potential challenges with using Computerized Adaptive Testing?

Introduction and Overview

Statistics Review for PSYC Measurement

Sychological Scaling

Test Preparation and Specification

Reliability Overview: Classical Test Theory

Estimating Reliability

Content Validation

Criterion-Related Validation

Construct Validation

VG Psychometric Meta-Analysis Copy

Tests Bias Unfairness and Equivalence

Developing Tests of Maximal Performance

Classical Test Theory Item Analysis

Scoring Tests

Developing Measures of Typical Performance

Response Biases

Multiple Regression

Exploratory Factor Analysis

Confirmatory Factor Analysis

Item Response Theory

Generalizability Theory

Filters

Which of the following concepts in computerized adaptive language relates to test security? 