Question 1

The statistical procedure that researchers use to identify underlying components that may exist in test without first proposing a formal model?

Accepted Answer

A)  a goodness-of-fit test 
B)  construct explication 
C)  exploratory factor analysis 
D)  confirmatory factor analysis

Question 2

When an underlying theory explains the relation between a predictor and a criterion based on a psychological theory, there is ______.

Accepted Answer

A)  concurrent evidence of validity 
B)  predictive evidence of validity 
C)  evidence of construct validity 
D)  convergent evidence of validity

Question 3

In 1954, the American Psychological Association (APA) published recommendations that suggested a new method for establishing validity in which the researcher provides evidence that the test measures behavior predicted by a psychological theory. What did the APA call this evidence?

Accepted Answer

A)  construct validity 
B)  factor analysis 
C)  multitrait, multimethod analysis 
D)  generalizability

Question 4

Evidence of construct validity is provided when convergent validity correlations are ______.

Accepted Answer

A)  higher than discriminant validity correlations 
B)  lower than discriminant validity correlations 
C)  the same as are discriminant validity correlations 
D)  similar as are discriminant validity correlations

Question 5

When a group of test items all share something in common that accounts for the high correlations among them, we can say they all share a common ______.

Accepted Answer

A)  cause 
B)  theory 
C)  nomological network 
D)  factor

Question 6

When the scores on a test correlate strongly with scores on other tests that measure the same construct, we say the test has ______.

Accepted Answer

A)  evidence of validity based on content 
B)  evidence of validity based on relations with external criteria 
C)  convergent evidence of validity 
D)  discriminant evidence of validity

Question 7

Who defines constructs?

Accepted Answer

A)  the American Psychological Association 
B)  leading researchers in the field 
C)  can vary from researcher to researcher 
D)  must not be allowed to vary

Question 8

Explain the process of establishing evidence of validity based on a test's relationship with constructs, including the various factors that can provide evidence of that validity.

Accepted Answer

The answer of Explain the process of establishing evidence of...

Question 9

If test scores correlate with measures of constructs that an underlying theory says are related, then we say the test has ______.

Accepted Answer

A)  convergent evidence of validity 
B)  discriminant evidence of validity 
C)  evidence of validity based on content 
D)  concurrent evidence of validity

Question 10

When researchers conduct a factor analysis procedure to see whether the factors they proposed in a test really exist in the test?

Accepted Answer

A)  exploratory factor analysis 
B)  confirmatory factor analysis 
C)  discriminant factor analysis 
D)  construct factor analysis

Question 11

Which one of the following does NOT provide evidence of construct validity?

Accepted Answer

A)  standard error of measurement 
B)  evidence of validity based on relations with external criteria 
C)  evidence of validity based on content 
D)  factor analysis

Question 12

Explain how Campbell and Fiske's Multitrait-Multimethod Matrix (MTMM) provides evidence of construct validity. Give examples and draw a MTMM matrix.

Accepted Answer

The answer of Explain how Campbell and Fiske's Multitrait-Multimethod Matrix...

Question 13

Discuss the roles of confirmatory and exploratory factor analysis in establishing construct validity. Give an example of a study using each type of factor analysis.

Accepted Answer

The answer of Discuss the roles of confirmatory and exploratory...

Question 14

What did theorists challenge about using validity evidence based on test content and/or validity evidence based on relationships with criteria to establish test validity?

Accepted Answer

A)  They challenged the use of validity based on content because it was not based on statistical analysis. 
B)  They challenged validity based on relationships with criteria because it did not require reliable tests. 
C)  They challenged both because the test was not directly being linked to an accepted theory of psychological behavior. 
D)  They challenged both because they did not rely on accepted ethical standards for testing.

Question 15

When test users accept evidence of construct validity, they must also accept what?

Accepted Answer

A)  underlying definition of the construct used in the validation process 
B)  evidence of validity for other tests of similar constructs 
C)  test as valid for all uses 
D)  validity of test takers' scores on the test

Question 16

When a researcher chooses three constructs that are unrelated in theory and three types of tests such as objective, projective, and a peer rating to measure each of the constructs, she is conducting a ______.

Accepted Answer

A)  multitrait-multimethod design 
B)  content validation study 
C)  generalizability study 
D)  factor analysis

Question 17

When test scores from a new test correlate with test scores from other tests that measure related constructs, they provide ______.

Accepted Answer

A)  concurrent evidence of validity 
B)  convergent evidence of validity 
C)  evidence of validity based on test content 
D)  predictive evidence of validity

Question 18

Which one of the following would be most likely to establish that a test is grounded in psychological theory?

Accepted Answer

A)  the correlation between test score and external criteria 
B)  the correlation between the test scores of the same people at two different points in time 
C)  a high coefficient alpha from a test of internal consistency 
D)  evidence of validity based on the test's relationship with other constructs

Question 19

Discuss the concept of a construct and give examples of theoretical constructs.

Accepted Answer

The answer of Discuss the concept of a construct and...

Question 20

In 1959, Campbell and Fiske designed a method for collecting evidence of reliability, convergent validity, and discriminant validity in one study. They called it the ______.

Accepted Answer

A)  exploratory method of factor analysis 
B)  confirmatory method of factor analysis 
C)  discriminatory method 
D)  multitrait-multimethod design

Exam 8: How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs