Question 1

Which of the following would not be considered an example of best practice for gathering evidence about the validity of a test?

Accepted Answer

A) Looking over the assessment questions to determine if the test is valid 
B) Evaluating the validation evidence in the test manual to determine if there is sufficient evidence for its use 
C) Questioning examinees about their performance strategies and/or responses to items 
D) Analyzing the internal structure of an instrument using factor analysis 
A) Looking over the assessment questions to determine if the test is valid 
B) Evaluating the validation evidence in the test manual to determine if there is sufficient evidence for its use 
C) Questioning examinees about their performance strategies and/or responses to items 
D) Analyzing the internal structure of an instrument using factor analysis

Question 2

It is necessary for all good tests and instruments to:

Accepted Answer

A) be reliable and valid. 
B) have appropriate national norms. 
C) have a normalized distribution of scores. 
D) be reviewed in the Mental Measurements Yearbook. 
A) be reliable and valid. 
B) have appropriate national norms. 
C) have a normalized distribution of scores. 
D) be reviewed in the Mental Measurements Yearbook.

Question 3

In using an assessment with subscales, a counselor should examine:

Accepted Answer

A) the validation evidence regarding the internal structure of the instrument with population that correspond to the counselor's clients 
B) the standard error of estimate for each subscale and only use subscales where the standard error of estimate are close to 1.00 
C) the expectancy tables for each subscale 
D) whether there is an equal number of items for each subscale as this is considered best practice in assessment 
A) the validation evidence regarding the internal structure of the instrument with population that correspond to the counselor's clients 
B) the standard error of estimate for each subscale and only use subscales where the standard error of estimate are close to 1.00 
C) the expectancy tables for each subscale 
D) whether there is an equal number of items for each subscale as this is considered best practice in assessment

Question 4

A multitrait-multimethod matrix involves:

Accepted Answer

A) correlating the instrument with other measures that are theoretically-related. 
B) correlating the instrument with other measures that are not theoretically-related. 
C) correlating the instrument with other measures that use the same and different assessment methods. 
D) all of the above. 
A) correlating the instrument with other measures that are theoretically-related. 
B) correlating the instrument with other measures that are not theoretically-related. 
C) correlating the instrument with other measures that use the same and different assessment methods. 
D) all of the above.

Question 5

Test specifications:

Accepted Answer

A) concern the organizational framework used to development an instrument. 
B) include the process of identifying assessment goals. 
C) address how objectives were developed. 
D) all of the above 
A) concern the organizational framework used to development an instrument. 
B) include the process of identifying assessment goals. 
C) address how objectives were developed. 
D) all of the above

Question 6

A method used in order to examine whether an instrument differentiates between the groups using the approach of decision theory is:

Accepted Answer

A) Expectancy Tables 
B) Tables of Specification 
C) Coefficient Alpha 
D) regression analysis 
A) Expectancy Tables 
B) Tables of Specification 
C) Coefficient Alpha 
D) regression analysis

Question 7

If the validity evidence focuses on the degree to which the evidence indicates the items, questions, or tasks adequately represent the intended behavior domain, which traditional category of validity would it be most related to?

Accepted Answer

A) content-related validity 
B) criterion-related validity 
C) concurrent validity 
D) predictive validity 
A) content-related validity 
B) criterion-related validity 
C) concurrent validity 
D) predictive validity

Question 8

In using regression to predict an individual's performance on the criterion based on his or her score on the instrument, the prediction is least accurate when the correlation is:

Accepted Answer

A) -1.00 
B) 0.00 
C) .50 
D) 1.00 
A) -1.00 
B) 0.00 
C) .50 
D) 1.00

Question 9

Validity evidence is to ________ as item analysis is to ________.

Accepted Answer

A) the entire instrument; qualities of each item 
B) validity; reliability 
C) accuracy; specificity 
D) new instrument; old/outdated instrument 
A) the entire instrument; qualities of each item 
B) validity; reliability 
C) accuracy; specificity 
D) new instrument; old/outdated instrument

Question 10

In order to determine if an instrument can be used appropriately in a certain situation, the counselor must:

Accepted Answer

A) talk to a clinician who has used the instrument. 
B) examine the reliability coefficients. 
C) examine the validation evidence. 
D) calculate a validity coefficient. 
A) talk to a clinician who has used the instrument. 
B) examine the reliability coefficients. 
C) examine the validation evidence. 
D) calculate a validity coefficient.

Question 11

An Expectancy Table is a useful device for determining the:

Accepted Answer

A) correlation between a selection test and a criterion. 
B) proportion of error that is expected in any prediction. 
C) cutoff score of a selection test. 
D) possible range of an individual's score on the criterion. 
A) correlation between a selection test and a criterion. 
B) proportion of error that is expected in any prediction. 
C) cutoff score of a selection test. 
D) possible range of an individual's score on the criterion.

Question 12

When we use Expectancy Tables, hit is to ________ as miss is to _________ .

Accepted Answer

A) reliability; validity 
B) right; wrong 
C) probability; possibility 
D) high score; low score 
A) reliability; validity 
B) right; wrong 
C) probability; possibility 
D) high score; low score

Question 13

A statistical technique often used to examine internal structure of an instrument is:

Accepted Answer

A) factor analysis 
B) meta-analysis 
C) internal analysis 
D) structural analysis 
A) factor analysis 
B) meta-analysis 
C) internal analysis 
D) structural analysis

Question 14

An example of a false negative is when an instrument:

Accepted Answer

A) identifies a client as not being suicidal when the client is 
B) correctly identifies a client as being suicidal 
C) identifies a client as being suicidal when the client is not 
D) correctly identifies a client as not being suicidal 
A) identifies a client as not being suicidal when the client is 
B) correctly identifies a client as being suicidal 
C) identifies a client as being suicidal when the client is not 
D) correctly identifies a client as not being suicidal

Question 15

When considering the criterion-related evidence of validity, one should be concerned with whether the criterion is:

Accepted Answer

A) reliable 
B) unbiased 
C) free from criterion contamination 
D) all of the above 
A) reliable 
B) unbiased 
C) free from criterion contamination 
D) all of the above

Question 16

If an assessment identifies a child as having ADHD when the child does not have ADHD, this would be an example of :

Accepted Answer

A) a false negative 
B) a false positive 
C) a correct diagnosis 
D) differential diagnosis 
A) a false negative 
B) a false positive 
C) a correct diagnosis 
D) differential diagnosis

Question 17

In the equation Y' = a + bX, the b represents the:

Accepted Answer

A) intercept or intercept constant 
B) slope or regression coefficients 
C) standard error of estimate 
D) predicted score on the criterion 
A) intercept or intercept constant 
B) slope or regression coefficients 
C) standard error of estimate 
D) predicted score on the criterion

Question 18

An instructor announces that an examination will cover the topics of counseling theories and techniques.You spend hours studying both concepts, but all of the test questions are only on techniques.You might correctly conclude that the examination:

Accepted Answer

A) lacked content validity 
B) lacked criterion-related validity 
C) was not reliable 
D) all of the above 
A) lacked content validity 
B) lacked criterion-related validity 
C) was not reliable 
D) all of the above

Question 19

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

Accepted Answer

A) Content-related 
B) Construct-related 
C) Criterion 
D) Predictive 
A) Content-related 
B) Construct-related 
C) Criterion 
D) Predictive

Question 20

Validation evidence based on instrument content is related to the concept of:

Accepted Answer

A) criterion-related validity 
B) reliability 
C) content validity 
D) none of the above 
A) criterion-related validity 
B) reliability 
C) content validity 
D) none of the above

Which of the following would not be considered an example of best practice for gathering evidence about the validity of a test?

It is necessary for all good tests and instruments to:

In using an assessment with subscales, a counselor should examine:

A multitrait-multimethod matrix involves:

Test specifications:

A method used in order to examine whether an instrument differentiates between the groups using the approach of decision theory is:

If the validity evidence focuses on the degree to which the evidence indicates the items, questions, or tasks adequately represent the intended behavior domain, which traditional category of validity would it be most related to?

In using regression to predict an individual's performance on the criterion based on his or her score on the instrument, the prediction is least accurate when the correlation is:

Validity evidence is to as item analysis is to .

In order to determine if an instrument can be used appropriately in a certain situation, the counselor must:

An Expectancy Table is a useful device for determining the:

When we use Expectancy Tables, hit is to as miss is to _ .

A statistical technique often used to examine internal structure of an instrument is:

An example of a false negative is when an instrument:

When considering the criterion-related evidence of validity, one should be concerned with whether the criterion is:

If an assessment identifies a child as having ADHD when the child does not have ADHD, this would be an example of :

In the equation Y' = a + bX, the b represents the:

An instructor announces that an examination will cover the topics of counseling theories and techniques.You spend hours studying both concepts, but all of the test questions are only on techniques.You might correctly conclude that the examination:

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

Validation evidence based on instrument content is related to the concept of:

Assessment in Counseling

Basic Assessment Principles

Reliability

Selection, Administration, Scoring, Communicating Assessment Results

Initial Assessment in Counseling

Intelligence General Ability Testing

Measuring Achievement Aptitude:applications for Counseling

Assessment in Career Counseling

Appraisal of Personality

Assessment in Marriage Family Counseling

Assessment and Diagnosis

Using Assessment in Counseling

Ethical and Legal Issues in Assessment

Issues Related to Assessment With Diverse Populations

Technological Applications and Future Trends

Filters

Exam 4: Validity and Item Analysis

Which of the following would not be considered an example of best practice for gathering evidence about the validity of a test?

It is necessary for all good tests and instruments to:

In using an assessment with subscales, a counselor should examine:

A multitrait-multimethod matrix involves:

Test specifications:

A method used in order to examine whether an instrument differentiates between the groups using the approach of decision theory is:

If the validity evidence focuses on the degree to which the evidence indicates the items, questions, or tasks adequately represent the intended behavior domain, which traditional category of validity would it be most related to?

In using regression to predict an individual's performance on the criterion based on his or her score on the instrument, the prediction is least accurate when the correlation is:

Validity evidence is to ________ as item analysis is to ________.

In order to determine if an instrument can be used appropriately in a certain situation, the counselor must:

An Expectancy Table is a useful device for determining the:

When we use Expectancy Tables, hit is to ________ as miss is to _________ .

A statistical technique often used to examine internal structure of an instrument is:

An example of a false negative is when an instrument:

When considering the criterion-related evidence of validity, one should be concerned with whether the criterion is:

If an assessment identifies a child as having ADHD when the child does not have ADHD, this would be an example of :

In the equation Y' = a + bX, the b represents the:

An instructor announces that an examination will cover the topics of counseling theories and techniques.You spend hours studying both concepts, but all of the test questions are only on techniques.You might correctly conclude that the examination:

Of the three historical types of validation evidence, which one is believed by many experts to be the most pertinent with assessments used by counselors?

Validation evidence based on instrument content is related to the concept of:

Assessment in Counseling

Basic Assessment Principles

Reliability

Selection, Administration, Scoring, Communicating Assessment Results

Initial Assessment in Counseling

Intelligence General Ability Testing

Measuring Achievement Aptitude:applications for Counseling

Assessment in Career Counseling

Appraisal of Personality

Assessment in Marriage Family Counseling

Assessment and Diagnosis

Using Assessment in Counseling

Ethical and Legal Issues in Assessment

Issues Related to Assessment With Diverse Populations

Technological Applications and Future Trends

Filters

Validity evidence is to as item analysis is to .

When we use Expectancy Tables, hit is to as miss is to _ .