Question 1

Define each of the following terms and provide examples for each: predictor variable,criterion,and criterion measures.

Accepted Answer

A predictor variable is a variable that is used to make predictions about the value of another variable. It is also known as an independent variable. For example, in a study looking at the relationship between study time and exam scores, study time would be the predictor variable as it is used to predict the exam scores.

A criterion is the variable that is being predicted or explained by the predictor variable. It is also known as a dependent variable. Using the previous example, exam scores would be the criterion as they are being predicted or explained by the study time.

Criterion measures are the specific ways in which the criterion variable is measured. These measures can include tests, surveys, observations, or any other method used to assess the criterion variable. In the study time and exam scores example, the criterion measure would be the actual exam scores obtained by the participants.

Question 2

Scores on the Kaufman Assessment Battery for Children have been shown to differ significantly between children with ADHD and children who are gifted.This is an example of which type of validity evidence?

Accepted Answer

A) Discriminant validity evidence 
B) Group differentiation studies 
C) Age differentiation studies 
D) Experimental differentiation studies 
A) Discriminant validity evidence 
B) Group differentiation studies 
C) Age differentiation studies 
D) Experimental differentiation studies B

Question 3

_________________ are concepts,ideas,or hypotheses that cannot be directly measured or observed

Accepted Answer

A) Constructs 
B) Variables 
C) Standards 
D) Specifications 
A) Constructs 
B) Variables 
C) Standards 
D) Specifications A

Question 4

In terms of accurate prediction of a criterion variable,a person who is predicted to do well during the first semester of college based on an SAT score)and then does poorly would fall into the __________ quadrant.

Accepted Answer

A) true positive 
B) true negative 
C) false positive 
D) false negative 
A) true positive 
B) true negative 
C) false positive 
D) false negative

Question 5

Comparing pre and post-test scores of two groups,one group that experienced an intervention and one group that did not,is an example of

Accepted Answer

A) factor analysis. 
B) contrasted group studies. 
C) experimental results. 
D) age differentiation studies. 
A) factor analysis. 
B) contrasted group studies. 
C) experimental results. 
D) age differentiation studies.

Question 6

Validity coefficients greater than _________ are considered in the very high range.

Accepted Answer

A) .50 
B) .60 
C) .70 
D) .80 
A) .50 
B) .60 
C) .70 
D) .80

Question 7

You are a test developer who is constructing a new test that measures test anxiety.Describe the process of validating the new test,focusing on a)relations to other variables evidence,b)evidence based on internal structure and c)test content validity evidence.

Accepted Answer

The process of validating a new test tha

Question 8

_________________ is calculated by correlating test scores with the scores of tests or measures that assess the same construct.

Accepted Answer

A) Convergent validity 
B) Discriminant validity 
C) Face validity 
D) Content validity 
A) Convergent validity 
B) Discriminant validity 
C) Face validity 
D) Content validity

Question 9

When discussing the relationship between reliability and validity,which of the following is true?

Accepted Answer

A) High reliability always indicates low degree of validity. 
B) High reliability always indicates high degree of validity. 
C) Low reliability always indicates high degree of validity. 
D) Low reliability always indicates low degree of validity. 
A) High reliability always indicates low degree of validity. 
B) High reliability always indicates high degree of validity. 
C) Low reliability always indicates high degree of validity. 
D) Low reliability always indicates low degree of validity.

Question 10

Evidence of homogeneity refers to

Accepted Answer

A) how uniform test items and components are in measuring one construct 
B) test items that have a low internal consistency 
C) the single construct measured most accurately by a test 
D) a correlation of test results from multiple measures 
A) how uniform test items and components are in measuring one construct 
B) test items that have a low internal consistency 
C) the single construct measured most accurately by a test 
D) a correlation of test results from multiple measures

Question 11

The tripartite view of validity includes content validity,criterion validity,and

Accepted Answer

A) discriminate validity 
B) convergent validity 
C) content validity 
D) construct validity 
A) discriminate validity 
B) convergent validity 
C) content validity 
D) construct validity

Question 12

According to Messick 1989),consequential validity includes

Accepted Answer

A) evaluating the actual and potential consequences of a given test 
B) assessing the social impact of a test's interpretations 
C) both a and b 
D) neither a nor b 
A) evaluating the actual and potential consequences of a given test 
B) assessing the social impact of a test's interpretations 
C) both a and b 
D) neither a nor b

Question 13

The following are all examples of constructs in education EXCEPT:

Accepted Answer

A) intelligence 
B) learning disabled 
C) grades 
D) achievement 
A) intelligence 
B) learning disabled 
C) grades 
D) achievement

Question 14

Exploratory factor analysis can be used to

Accepted Answer

A) investigate the differences between groups 
B) develop new testing instruments 
C) confirm expectations about a scale's dimensions 
D) determine if a test produces negative consequences 
A) investigate the differences between groups 
B) develop new testing instruments 
C) confirm expectations about a scale's dimensions 
D) determine if a test produces negative consequences

Question 15

Criterion measures that are chosen for the validation process must be

Accepted Answer

A) relevant 
B) uncontaminated 
C) reliable 
D) All of the above 
A) relevant 
B) uncontaminated 
C) reliable 
D) All of the above

Question 16

The ______________ is characterized by assessing both convergent and discriminant validity evidence and displaying data on a table of correlations.

Accepted Answer

A) multitrait-multimethod matrix 
B) contrasted group study 
C) age differentiation study 
D) factor matrix 
A) multitrait-multimethod matrix 
B) contrasted group study 
C) age differentiation study 
D) factor matrix

Question 17

A counselor is considering using a personality assessment with a client who immigrated to the United States from China four years ago.The test has a low level of validity with this specific population.Discuss the potential consequences of using this test.

Accepted Answer

Using a personality assessment with low

Question 18

What information is included on a Multitrait-Multimethod Matrix?

Accepted Answer

A) subtests and correlations between each subtest 
B) methods of assessment,traits examined,and correlations 
C) loading factors and correlations of subtests 
D) false positives,false negatives,true positives,and true negatives 
A) subtests and correlations between each subtest 
B) methods of assessment,traits examined,and correlations 
C) loading factors and correlations of subtests 
D) false positives,false negatives,true positives,and true negatives

Question 19

___________________________ is a threat to validity that implies that a test is too narrow and fails to include important dimensions or aspects of the identified construct.

Accepted Answer

A) Content underrepresentation 
B) Content-irrelevant variance 
C) Construct underrepresentation 
D) Construct-irrelevant variance 
A) Content underrepresentation 
B) Content-irrelevant variance 
C) Construct underrepresentation 
D) Construct-irrelevant variance

Question 20

To evaluate a content validity evidence,test developers may use

Accepted Answer

A) expert judges 
B) factor analysis 
C) experimental results 
D) evidence of homogeneity 
A) expert judges 
B) factor analysis 
C) experimental results 
D) evidence of homogeneity

Define each of the following terms and provide examples for each: predictor variable,criterion,and criterion measures.

Scores on the Kaufman Assessment Battery for Children have been shown to differ significantly between children with ADHD and children who are gifted.This is an example of which type of validity evidence?

_________________ are concepts,ideas,or hypotheses that cannot be directly measured or observed

In terms of accurate prediction of a criterion variable,a person who is predicted to do well during the first semester of college based on an SAT score)and then does poorly would fall into the __________ quadrant.

Comparing pre and post-test scores of two groups,one group that experienced an intervention and one group that did not,is an example of

Validity coefficients greater than _________ are considered in the very high range.

You are a test developer who is constructing a new test that measures test anxiety.Describe the process of validating the new test,focusing on a)relations to other variables evidence,b)evidence based on internal structure and c)test content validity evidence.

_________________ is calculated by correlating test scores with the scores of tests or measures that assess the same construct.

When discussing the relationship between reliability and validity,which of the following is true?

Evidence of homogeneity refers to

The tripartite view of validity includes content validity,criterion validity,and

According to Messick 1989),consequential validity includes

The following are all examples of constructs in education EXCEPT:

Exploratory factor analysis can be used to

Criterion measures that are chosen for the validation process must be

The ______________ is characterized by assessing both convergent and discriminant validity evidence and displaying data on a table of correlations.

A counselor is considering using a personality assessment with a client who immigrated to the United States from China four years ago.The test has a low level of validity with this specific population.Discuss the potential consequences of using this test.

What information is included on a Multitrait-Multimethod Matrix?

___________________________ is a threat to validity that implies that a test is too narrow and fails to include important dimensions or aspects of the identified construct.

To evaluate a content validity evidence,test developers may use

Introduction to Assessment

Methods and Sources of Assessment Information

Statistical Concepts

Understanding Assessment Scores

Reliability

Selecting,administering,scoring,and Interpreting Assessment Results

Assessment of Intelligence and General Ability

Assessment of Achievement

Assessment of Aptitude

Career and Employment Assessment

Clinical Assessment

Assessment in Education

Assessment Issues With Diverse Populations

Communicating Assessment Results

Ethical and Legal Issues in Assessment

Filters

Exam 6: Validity

Define each of the following terms and provide examples for each: predictor variable,criterion,and criterion measures.

Scores on the Kaufman Assessment Battery for Children have been shown to differ significantly between children with ADHD and children who are gifted.This is an example of which type of validity evidence?

_________________ are concepts,ideas,or hypotheses that cannot be directly measured or observed

In terms of accurate prediction of a criterion variable,a person who is predicted to do well during the first semester of college based on an SAT score)and then does poorly would fall into the __________ quadrant.

Comparing pre and post-test scores of two groups,one group that experienced an intervention and one group that did not,is an example of

Validity coefficients greater than _________ are considered in the very high range.

You are a test developer who is constructing a new test that measures test anxiety.Describe the process of validating the new test,focusing on a)relations to other variables evidence,b)evidence based on internal structure and c)test content validity evidence.

_________________ is calculated by correlating test scores with the scores of tests or measures that assess the same construct.

When discussing the relationship between reliability and validity,which of the following is true?

Evidence of homogeneity refers to

The tripartite view of validity includes content validity,criterion validity,and

According to Messick 1989),consequential validity includes

The following are all examples of constructs in education EXCEPT:

Exploratory factor analysis can be used to

Criterion measures that are chosen for the validation process must be

The ______________ is characterized by assessing both convergent and discriminant validity evidence and displaying data on a table of correlations.

A counselor is considering using a personality assessment with a client who immigrated to the United States from China four years ago.The test has a low level of validity with this specific population.Discuss the potential consequences of using this test.

What information is included on a Multitrait-Multimethod Matrix?

___________________________ is a threat to validity that implies that a test is too narrow and fails to include important dimensions or aspects of the identified construct.

To evaluate a content validity evidence,test developers may use

Introduction to Assessment

Methods and Sources of Assessment Information

Statistical Concepts

Understanding Assessment Scores

Reliability

Selecting,administering,scoring,and Interpreting Assessment Results

Assessment of Intelligence and General Ability

Assessment of Achievement

Assessment of Aptitude

Career and Employment Assessment

Clinical Assessment

Assessment in Education

Assessment Issues With Diverse Populations

Communicating Assessment Results

Ethical and Legal Issues in Assessment

Filters