Question 1

Using decision theory, both expectancy tables and group separation help to determine:

Accepted Answer

A) differences between the standardization group and the population of interest. 
B) whether an instrument differentiates between groups. 
C) whether or not counselors should decide to use an instrument based on the groups represented in the norming sample. 
D) whether or not males and females should be separated during group test administration. 
A) differences between the standardization group and the population of interest. 
B) whether an instrument differentiates between groups. 
C) whether or not counselors should decide to use an instrument based on the groups represented in the norming sample. 
D) whether or not males and females should be separated during group test administration. B

Question 2

One fundamental assumption of item response theory is that each item is constructed so that it measures only one trait or ability. This assumption is known as:

Accepted Answer

A) the one-trait assumption. 
B) single ability measurement. 
C) unitary attribute theory. 
D) unidimensionality. 
A) the one-trait assumption. 
B) single ability measurement. 
C) unitary attribute theory. 
D) unidimensionality. D

Question 3

If an instrument measures consistently but does not measure what it was designed to measure, the instrument is:

Accepted Answer

A) valid but not reliable. 
B) reliable but not valid. 
C) standardized but not reliable. 
D) reliable but not normative. 
A) valid but not reliable. 
B) reliable but not valid. 
C) standardized but not reliable. 
D) reliable but not normative. B

Question 4

In the equation Y' = a + b X, the b represents the:

Accepted Answer

A) intercept or intercept constant. 
B) slope or regression coefficients. 
C) standard error of estimate. 
D) predicted score on the criterion. 
A) intercept or intercept constant. 
B) slope or regression coefficients. 
C) standard error of estimate. 
D) predicted score on the criterion.

Question 5

Briefly explain the basis of item response theory.  How does it differ from classical test theory?  What are some of the benefits and challenges to each of these theories?  Are there times when one would be more appropriate to employ than the other?  What are item characteristic curves, and what information can they provide?

Accepted Answer

Item response theory (IRT) is a statisti

Question 6

An important parameter in item response theory is the slope of the curve, which is an indicator of how well the item discriminates.  If there is a ________  slope then the item is probably a good discriminator ,whereas a ________ slope probably indicates the item does not discriminate very well.

Accepted Answer

A) flat; steep 
B) symmetrical; asymmetrical 
C) steep; flat 
D) asymmetrical; symmetrical 
A) flat; steep 
B) symmetrical; asymmetrical 
C) steep; flat 
D) asymmetrical; symmetrical

Question 7

An example of gathering evidence based on response processes is:

Accepted Answer

A) comparing scores on one assessment to a similar assessment. 
B) asking individual's to "think aloud" while completing an inventory. 
C) looking for patterns of answers within an identified assessment. 
D) having individuals rate their perceived accuracy of a completed assessment. 
A) comparing scores on one assessment to a similar assessment. 
B) asking individual's to "think aloud" while completing an inventory. 
C) looking for patterns of answers within an identified assessment. 
D) having individuals rate their perceived accuracy of a completed assessment.

Question 8

The standard error of estimate is an index of the:

Accepted Answer

A) accuracy of the instrument scores. 
B) content validity of a test. 
C) reliability of an instrument. 
D) probable range of scores on the criterion. 
A) accuracy of the instrument scores. 
B) content validity of a test. 
C) reliability of an instrument. 
D) probable range of scores on the criterion.

Question 9

Standard error of measurement is to standard error of estimate as:

Accepted Answer

A) concurrent validity is to predictive validity. 
B) content validity is to face validity. 
C) a reliability coefficient is to a validity coefficient. 
D) a normal distribution is to a skewed distribution. 
A) concurrent validity is to predictive validity. 
B) content validity is to face validity. 
C) a reliability coefficient is to a validity coefficient. 
D) a normal distribution is to a skewed distribution.

Question 10

Validity evidence is to ________ as item analysis is to ________.

Accepted Answer

A) the entire instrument; qualities of each item 
B) validity; reliability 
C) accuracy; specificity 
D) new instrument; old/outdated instrument 
A) the entire instrument; qualities of each item 
B) validity; reliability 
C) accuracy; specificity 
D) new instrument; old/outdated instrument

Question 11

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

Accepted Answer

A) Content-related 
B) Construct-related 
C) Criterion 
D) Predictive 
A) Content-related 
B) Construct-related 
C) Criterion 
D) Predictive

Question 12

A low, non-significant correlation between an observation-based assessment of symptoms of autism and a teacher-report of ADHD symptoms provides ______________________ evidence of the validity of the autism measure.

Accepted Answer

A) convergent 
B) multimethod 
C) discriminant 
D) differential 
A) convergent 
B) multimethod 
C) discriminant 
D) differential

Question 13

There are many methods of gathering construct validity information.  Briefly discuss each process and its advantages and disadvantages: convergent and discriminant evidence; multitrait-multimethod matrix; factor analysis; meta-analysis; correlational method; regression.

Accepted Answer

Convergent and discriminant evidence inv

Question 14

In evaluating an instrument's validity, practitioners should:

Accepted Answer

A) always select an instrument that has the highest validity coefficients. 
B) be convinced by the preponderance of evidence on the appropriate use of that instrument. 
C) not use an instrument unless a factor analysis has been conducted. 
D) select those instruments that have a multitrait-multimethod matrix. 
A) always select an instrument that has the highest validity coefficients. 
B) be convinced by the preponderance of evidence on the appropriate use of that instrument. 
C) not use an instrument unless a factor analysis has been conducted. 
D) select those instruments that have a multitrait-multimethod matrix.

Question 15

The higher the item difficulty index (i.e., 0.00 to 1.00), the ________ the item.

Accepted Answer

A) easier 
B) harder 
C) more reliable 
D) less reliable 
A) easier 
B) harder 
C) more reliable 
D) less reliable

Question 16

When we use Expectancy Tables, hit is to ________ as miss is to _________ .

Accepted Answer

A) reliability; validity 
B) right; wrong 
C) probability; possibility 
D) high score; low score 
A) reliability; validity 
B) right; wrong 
C) probability; possibility 
D) high score; low score

Question 17

Validity is explained as the gradual accumulation of evidence that indicates how an instrument can be used and what can be inferred from the results.  What does this mean for the use of newly-developed instruments that have not existed long enough for evidence of validity to accumulate?

Accepted Answer

For newly-developed instruments that hav

Question 18

The difference between concurrent and predictive validity is whether the:

Accepted Answer

A) prediction is made in the current context or in the future. 
B) focus is on the normative sample or the content of the items. 
C) instrument is designed for adults or children. 
D) evidence is analyzed using regression or analysis of variance. 
A) prediction is made in the current context or in the future. 
B) focus is on the normative sample or the content of the items. 
C) instrument is designed for adults or children. 
D) evidence is analyzed using regression or analysis of variance.

Question 19

The most comprehensive type of validity that incorporates a gradual accumulation of evidence is __________ validity.

Accepted Answer

A) concurrent 
B) content 
C) predictive 
D) construct 
A) concurrent 
B) content 
C) predictive 
D) construct

Question 20

In appraisal, regression equations are most frequently used to:

Accepted Answer

A) predict test-takers' performance on the criterion. 
B) compute test-retest reliability. 
C) measure developmental changes. 
D) analyze the makeup of the norming group. 
A) predict test-takers' performance on the criterion. 
B) compute test-retest reliability. 
C) measure developmental changes. 
D) analyze the makeup of the norming group.

Using decision theory, both expectancy tables and group separation help to determine:

One fundamental assumption of item response theory is that each item is constructed so that it measures only one trait or ability. This assumption is known as:

If an instrument measures consistently but does not measure what it was designed to measure, the instrument is:

In the equation Y' = a + b X, the b represents the:

An important parameter in item response theory is the slope of the curve, which is an indicator of how well the item discriminates. If there is a slope then the item is probably a good discriminator ,whereas a slope probably indicates the item does not discriminate very well.

An example of gathering evidence based on response processes is:

The standard error of estimate is an index of the:

Standard error of measurement is to standard error of estimate as:

Validity evidence is to as item analysis is to .

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

A low, non-significant correlation between an observation-based assessment of symptoms of autism and a teacher-report of ADHD symptoms provides ______________________ evidence of the validity of the autism measure.

There are many methods of gathering construct validity information. Briefly discuss each process and its advantages and disadvantages: convergent and discriminant evidence; multitrait-multimethod matrix; factor analysis; meta-analysis; correlational method; regression.

In evaluating an instrument's validity, practitioners should:

The higher the item difficulty index (i.e., 0.00 to 1.00), the ________ the item.

When we use Expectancy Tables, hit is to as miss is to _ .

Validity is explained as the gradual accumulation of evidence that indicates how an instrument can be used and what can be inferred from the results. What does this mean for the use of newly-developed instruments that have not existed long enough for evidence of validity to accumulate?

The difference between concurrent and predictive validity is whether the:

The most comprehensive type of validity that incorporates a gradual accumulation of evidence is __________ validity.

In appraisal, regression equations are most frequently used to:

Assessment in Counseling

Basic Assessment Principles

Reliability

Ethical and Legal Issues in Assessment

Issues Related to Assessment With Diverse Populations

Selecting Administering Scoring and Communicating Assessment Results

Initial Assessment in Counseling

Intelligence and General Ability Testing

Assessing Achievement and Aptitude Applications for Counseling

Assessment in Career Counseling

Appraisal of Personality

Behavioral Assessment

Assessment in Marriage and Family Counseling

Diagnosis

Monitoring and Evaluating Counseling

Filters

Exam 4: Validity and Item Analysis

Using decision theory, both expectancy tables and group separation help to determine:

One fundamental assumption of item response theory is that each item is constructed so that it measures only one trait or ability. This assumption is known as:

If an instrument measures consistently but does not measure what it was designed to measure, the instrument is:

In the equation Y' = a + b X, the b represents the:

An important parameter in item response theory is the slope of the curve, which is an indicator of how well the item discriminates. If there is a ________ slope then the item is probably a good discriminator ,whereas a ________ slope probably indicates the item does not discriminate very well.

An example of gathering evidence based on response processes is:

The standard error of estimate is an index of the:

Standard error of measurement is to standard error of estimate as:

Validity evidence is to ________ as item analysis is to ________.

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

A low, non-significant correlation between an observation-based assessment of symptoms of autism and a teacher-report of ADHD symptoms provides ______________________ evidence of the validity of the autism measure.

There are many methods of gathering construct validity information. Briefly discuss each process and its advantages and disadvantages: convergent and discriminant evidence; multitrait-multimethod matrix; factor analysis; meta-analysis; correlational method; regression.

In evaluating an instrument's validity, practitioners should:

The higher the item difficulty index (i.e., 0.00 to 1.00), the ________ the item.

When we use Expectancy Tables, hit is to ________ as miss is to _________ .

Validity is explained as the gradual accumulation of evidence that indicates how an instrument can be used and what can be inferred from the results. What does this mean for the use of newly-developed instruments that have not existed long enough for evidence of validity to accumulate?

The difference between concurrent and predictive validity is whether the:

The most comprehensive type of validity that incorporates a gradual accumulation of evidence is __________ validity.

In appraisal, regression equations are most frequently used to:

Assessment in Counseling

Basic Assessment Principles

Reliability

Ethical and Legal Issues in Assessment

Issues Related to Assessment With Diverse Populations

Selecting Administering Scoring and Communicating Assessment Results

Initial Assessment in Counseling

Intelligence and General Ability Testing

Assessing Achievement and Aptitude Applications for Counseling

Assessment in Career Counseling

Appraisal of Personality

Behavioral Assessment

Assessment in Marriage and Family Counseling

Diagnosis

Monitoring and Evaluating Counseling

Filters

An important parameter in item response theory is the slope of the curve, which is an indicator of how well the item discriminates. If there is a slope then the item is probably a good discriminator ,whereas a slope probably indicates the item does not discriminate very well.

Validity evidence is to as item analysis is to .

When we use Expectancy Tables, hit is to as miss is to _ .