Question 1

In Guttman scaling

Accepted Answer

A)  testtakers are presented with a forced-choice format. 
B)  each item is completely independent of every other item and nothing can be concluded as the result of the endorsement of an item. 
C)  when one item is endorsed by a testtaker, the less extreme aspects of that item are also endorsed. 
D)  when more than one item tapping a particular content area is endorsed, the less extreme aspects of those items are also endorsed. 
A)  testtakers are presented with a forced-choice format. 
B)  each item is completely independent of every other item and nothing can be concluded as the result of the endorsement of an item. 
C)  when one item is endorsed by a testtaker, the less extreme aspects of that item are also endorsed. 
D)  when more than one item tapping a particular content area is endorsed, the less extreme aspects of those items are also endorsed.

Question 2

As part of the process of test development,the term test revision BEST refers to the

Accepted Answer

A)  rewording, deletion, or development of new items. 
B)  development of a completely new test. 
C)  reprinting of a test after a previous edition has sold out. 
D)  Both a and b 
A)  rewording, deletion, or development of new items. 
B)  development of a completely new test. 
C)  reprinting of a test after a previous edition has sold out. 
D)  Both a and b

Question 3

A test developer designs a test for the sole purpose of identifying the most highly skilled individuals among those tested.During the test revision stage of test development,the test developer will be particularly interested in

Accepted Answer

A)  item bias. 
B)  item discrimination. 
C)  item reliability. 
D)  item validity. 
A)  item bias. 
B)  item discrimination. 
C)  item reliability. 
D)  item validity.

Question 4

In contrast to scaling methods that employ indirect estimation,scaling methods that employ direct estimation do not require:

Accepted Answer

A)  writing two sets of items for parallel forms. 
B)  the use of the method of equal-appearing intervals. 
C)  transforming testtaker responses into some other scale. 
D)  indirect methods to interpret testtaker responses. 
A)  writing two sets of items for parallel forms. 
B)  the use of the method of equal-appearing intervals. 
C)  transforming testtaker responses into some other scale. 
D)  indirect methods to interpret testtaker responses.

Question 5

A student raises concern that a professor has given different grades to two essay answers that are very similar.From a psychometric perspective,the student is expressing concerns about

Accepted Answer

A)  criterion-related validity. 
B)  rater error. 
C)  test-retest reliability. 
D)  parallel forms reliability. 
A)  criterion-related validity. 
B)  rater error. 
C)  test-retest reliability. 
D)  parallel forms reliability.

Question 6

Which of the following conditions may lead to the decision to revise a psychological or educational test?

Accepted Answer

A)  item content, including the vocabulary used in instructions and pictures, has become dated 
B)  test norms no longer represent the population for which the test is designed 
C)  reliability and validity of a test can be improved by a revision 
D)  All of these 
A)  item content, including the vocabulary used in instructions and pictures, has become dated 
B)  test norms no longer represent the population for which the test is designed 
C)  reliability and validity of a test can be improved by a revision 
D)  All of these

Question 7

Scoring drift refers to

Accepted Answer

A)  the tendency of scorers to give higher scores to testtakers with certain characteristics (such as age and gender) that is similar to themselves. 
B)  differences between the typical scoring of an item during standardization and subsequent, more authoritative scoring of an item. 
C)  a gradual decline in inter-scorer reliability after 95% of the examinations have been scored due to scorer fatigue. 
D)  a flexible method of scoring test items for populations other than that of the standardization sample. 
A)  the tendency of scorers to give higher scores to testtakers with certain characteristics (such as age and gender) that is similar to themselves. 
B)  differences between the typical scoring of an item during standardization and subsequent, more authoritative scoring of an item. 
C)  a gradual decline in inter-scorer reliability after 95% of the examinations have been scored due to scorer fatigue. 
D)  a flexible method of scoring test items for populations other than that of the standardization sample.

Question 8

One of the questions that the developer of a new test must answer is,"Should more than one form of the test be developed?" In answering this question,a primary consideration is

Accepted Answer

A)  development costs. 
B)  test content. 
C)  test reliability. 
D)  item discrimination. 
A)  development costs. 
B)  test content. 
C)  test reliability. 
D)  item discrimination.

Question 9

What is the value of the item-discrimination index for an item that all the students in the higher-scoring group answered correctly but that no one in the lower-scoring group answered correctly?

Accepted Answer

A)  -1 
B)  +1 
C)  .50 
D)  .25 
A)  -1 
B)  +1 
C)  .50 
D)  .25

Question 10

The best type of item yields an item-characteristic curve that

Accepted Answer

A)  has a positive slope. 
B)  has a negative slope. 
C)  is leptokurtic. 
D)  has few, if any, outliers. 
A)  has a positive slope. 
B)  has a negative slope. 
C)  is leptokurtic. 
D)  has few, if any, outliers.

Question 11

If an item-discrimination index is negative

Accepted Answer

A)  high scorers are more likely to have answered the item correctly than low scorers. 
B)  low scorers are more likely to have answered the item correctly than high scorers. 
C)  the alternate form of the test is probably not equivalent. 
D)  the computer scoring is in error because this index is not supposed to be negative. 
A)  high scorers are more likely to have answered the item correctly than low scorers. 
B)  low scorers are more likely to have answered the item correctly than high scorers. 
C)  the alternate form of the test is probably not equivalent. 
D)  the computer scoring is in error because this index is not supposed to be negative.

Question 12

Having a large item pool available during test revision is

Accepted Answer

A)  a disadvantage due to the great expense of item development. 
B)  often a waste of time because many of the items are eventually deleted. 
C)  an advantage because poor items can be deleted in favor of the good items. 
D)  a great perk for test developers who are swimming enthusiasts. 
A)  a disadvantage due to the great expense of item development. 
B)  often a waste of time because many of the items are eventually deleted. 
C)  an advantage because poor items can be deleted in favor of the good items. 
D)  a great perk for test developers who are swimming enthusiasts.

Question 13

Which statement best describes the relationship between item difficulty and a "good" item?

Accepted Answer

A)  The difficulty level is not a factor in determining a "good" item. 
B)  An item with a high difficulty level is likely to be "good." 
C)  An item with a mid-range difficulty level is likely to be "good." 
D)  An item with a low difficulty level is likely to be "good." 
A)  The difficulty level is not a factor in determining a "good" item. 
B)  An item with a high difficulty level is likely to be "good." 
C)  An item with a mid-range difficulty level is likely to be "good." 
D)  An item with a low difficulty level is likely to be "good."

Question 14

Which statement is TRUE of guessing?

Accepted Answer

A)  It occurs more often on achievement than personality tests. 
B)  It posts methodological problems for the testtaker. 
C)  Most testtakers guess based on little knowledge of the subject matter. 
D)  It poses methodological problems for the test developer. 
A)  It occurs more often on achievement than personality tests. 
B)  It posts methodological problems for the testtaker. 
C)  Most testtakers guess based on little knowledge of the subject matter. 
D)  It poses methodological problems for the test developer.

Question 15

Item analysis is conducted to evaluate

Accepted Answer

A)  item reliability. 
B)  item validity. 
C)  item difficulty. 
D)  All of these 
A)  item reliability. 
B)  item validity. 
C)  item difficulty. 
D)  All of these

Question 16

One of the questions that the developer of a new test must answer is,"How will the test be administered?" The answer to this question may be

Accepted Answer

A)  the test will be individually administered. 
B)  the test will be group administered. 
C)  the test will be individually or group administered. 
D)  None of these 
A)  the test will be individually administered. 
B)  the test will be group administered. 
C)  the test will be individually or group administered. 
D)  None of these

Question 17

Which is NOT a typical question that is raised and answered during the test conceptualization stage of test development?

Accepted Answer

A)  What is the objective of the test? 
B)  Is there a need for the test? 
C)  How valid are the items on the test? 
D)  What types of responses will be required of the testtaker? 
A)  What is the objective of the test? 
B)  Is there a need for the test? 
C)  How valid are the items on the test? 
D)  What types of responses will be required of the testtaker?

Question 18

Which is an example of the selected-response item format?

Accepted Answer

A)  a multiple-choice item 
B)  a fill-in-the-blank item 
C)  Both a and b 
D)  None of these 
A)  a multiple-choice item 
B)  a fill-in-the-blank item 
C)  Both a and b 
D)  None of these

Question 19

At the end-point in the process of creating an item bank,the final version of a test may take the form of an instrument

Accepted Answer

A)  suitable for computerized-adaptive testing. 
B)  that has all of the items "fixed." 
C)  Both a and b 
D)  None of these 
A)  suitable for computerized-adaptive testing. 
B)  that has all of the items "fixed." 
C)  Both a and b 
D)  None of these

Question 20

The idea for a new test may come from

Accepted Answer

A)  social need. 
B)  review of the available literature. 
C)  common sense appeal. 
D)  All of these 
A)  social need. 
B)  review of the available literature. 
C)  common sense appeal. 
D)  All of these

In Guttman scaling

As part of the process of test development,the term test revision BEST refers to the

A test developer designs a test for the sole purpose of identifying the most highly skilled individuals among those tested.During the test revision stage of test development,the test developer will be particularly interested in

In contrast to scaling methods that employ indirect estimation,scaling methods that employ direct estimation do not require:

A student raises concern that a professor has given different grades to two essay answers that are very similar.From a psychometric perspective,the student is expressing concerns about

Which of the following conditions may lead to the decision to revise a psychological or educational test?

Scoring drift refers to

One of the questions that the developer of a new test must answer is,"Should more than one form of the test be developed?" In answering this question,a primary consideration is

What is the value of the item-discrimination index for an item that all the students in the higher-scoring group answered correctly but that no one in the lower-scoring group answered correctly?

The best type of item yields an item-characteristic curve that

If an item-discrimination index is negative

Having a large item pool available during test revision is

Which statement best describes the relationship between item difficulty and a "good" item?

Which statement is TRUE of guessing?

Item analysis is conducted to evaluate

One of the questions that the developer of a new test must answer is,"How will the test be administered?" The answer to this question may be

Which is NOT a typical question that is raised and answered during the test conceptualization stage of test development?

Which is an example of the selected-response item format?

At the end-point in the process of creating an item bank,the final version of a test may take the form of an instrument

The idea for a new test may come from

Psychological Testing and Assessment

Historical, cultural, and Legal Ethical Considerations

A Statistics Refresher

Of Tests and Testing

Reliability

Validity

Utility

Intelligence and Its Measurement

Tests of Intelligence

Assessment for Education

Personality Assessment: An Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment, Careers, and Business References

Filters

Exam 8: Test Development

In Guttman scaling

As part of the process of test development,the term test revision BEST refers to the

A test developer designs a test for the sole purpose of identifying the most highly skilled individuals among those tested.During the test revision stage of test development,the test developer will be particularly interested in

In contrast to scaling methods that employ indirect estimation,scaling methods that employ direct estimation do not require:

A student raises concern that a professor has given different grades to two essay answers that are very similar.From a psychometric perspective,the student is expressing concerns about

Which of the following conditions may lead to the decision to revise a psychological or educational test?

Scoring drift refers to

One of the questions that the developer of a new test must answer is,"Should more than one form of the test be developed?" In answering this question,a primary consideration is

What is the value of the item-discrimination index for an item that all the students in the higher-scoring group answered correctly but that no one in the lower-scoring group answered correctly?

The best type of item yields an item-characteristic curve that

If an item-discrimination index is negative

Having a large item pool available during test revision is

Which statement best describes the relationship between item difficulty and a "good" item?

Which statement is TRUE of guessing?

Item analysis is conducted to evaluate

One of the questions that the developer of a new test must answer is,"How will the test be administered?" The answer to this question may be

Which is NOT a typical question that is raised and answered during the test conceptualization stage of test development?

Which is an example of the selected-response item format?

At the end-point in the process of creating an item bank,the final version of a test may take the form of an instrument

The idea for a new test may come from

Psychological Testing and Assessment

Historical, cultural, and Legal Ethical Considerations

A Statistics Refresher

Of Tests and Testing

Reliability

Validity

Utility

Intelligence and Its Measurement

Tests of Intelligence

Assessment for Education

Personality Assessment: An Overview

Personality Assessment Methods

Clinical and Counseling Assessment

Neuropsychological Assessment

Assessment, Careers, and Business References

Filters