Question 1

Which one of the following statements is FALSE?

Accepted Answer

A)   Evidence for validity of a criterion can be gathered using a similar process to that used when establishing evidence of validity of a test based on content.
B)   Criteria must be representative of the events they are supposed to measure.
C)   A criterion is valid to the extent that it matches or represents the events in question.
D)   Unlike tests, reliability or consistency is unimportant for criteria. D

Question 2

A statistical analysis that has more than one set of test scores used for predicting a criterion is called ______.

Accepted Answer

A)   multiple regression
B)   linear regression
C)   criterion validity
D)   predictive validity A

Question 3

Watson, Detra, Fox, Ewing, Gearhart, and DeMotts (1996) administered two self-report alcoholism measures to 118 volunteers recruited from a Veterans Administration Medical Center. At approximately the same time, they asked the volunteers to complete the Diagnostic Interview Schedule. The study is an example of ______.

Accepted Answer

A)   multiple regression study
B)   concurrent evidence of validity study
C)   predictive evidence of validity study
D)   restriction-of-range study B

Question 4

Write the linear regression formula. Identify and explain each component of the formula.

Accepted Answer

The answer of Write the linear regression formula. Identify and...

Question 5

Describe the difference between reliability/precision and evidence of validity based a test's relations with criterion. Give examples.

Accepted Answer

The answer of Describe the difference between reliability/precision and evidence...

Question 6

The criterion of success in college is most often students' ______.

Accepted Answer

A)   classroom test scores
B)   professors' ratings
C)   grade point average
D)   community service activities

Question 7

What do we call the measure of performance that we expect to correlate with test scores?

Accepted Answer

A)   the predictor
B)   the criterion
C)   a standardized test
D)   an intercept

Question 8

Discuss two distinct methods of evaluating validity coefficients. Explain and give examples of the differences in information that the two methods provide.

Accepted Answer

The answer of Discuss two distinct methods of evaluating validity...

Question 9

Which one of the following criteria in an organizational setting is objective?

Accepted Answer

A)   customer satisfaction surveys
B)   sales judgments
C)   supervisor ratings
D)   number of excused absences

Question 10

Which one of the following is most likely to be the criterion measure for establishing evidence of validity based on relations with external criteria for a clinical psychological test?

Accepted Answer

A)   academic ability
B)   intelligence quotient
C)   job performance ratings
D)   diagnoses made by two or more clinicians

Question 11

R2 Change is a statistic from a multiple regression which is useful in determining what?

Accepted Answer

A)   correlation coefficient between two tests
B)   place where a regression line crosses the y-axis in a regression
C)   amount of measurement error present in a test score
D)   whether adding an additional test to a test battery is justified

Question 12

Jane is putting together a battery of tests to select employees for her company. She is already using a test of cognitive ability and a test of numerical reasoning. She is now considering adding a personality test as well. Which one of the following would be the best statistical procedure to help make a decision about whether to add the personality test?

Accepted Answer

A)   correlation
B)   simple linear regression
C)   multiple regression
D)   Cohen's kappa

Question 13

If we wanted to predict job performance using the results of a personality test and an intelligence test, which of the following statistical techniques would be best to use?

Accepted Answer

A)   coefficient of determination
B)   linear regression
C)   multiple regression
D)   correlation

Question 14

A p value < .01 tells the test user that the likelihood that the relationship being measured was found by chance was ______.

Accepted Answer

A)   less than 5 chances of 100
B)   less than 1 chance of 100
C)   not significant
D)   significant

Question 15

A time interval must elapse between the test administration and the criterion measurement when using which method for establishing evidence of validity?

Accepted Answer

A)   concurrent
B)   test-retest
C)   predictive
D)   content

Question 16

In organizational settings, researchers often use _____ studies as alternatives to _____ studies, because employers do not want to hire applicants with low test scores.

Accepted Answer

A)   concurrent; predictive
B)   predictive; concurrent
C)   concurrent; content
D)   predictive; content

Question 17

When psychologists use the predictive method to establish evidence of validity for a pre-employment test, they ask the employer to ______.

Accepted Answer

A)   hire all the applicants who take the test
B)   hire all the applicants who pass the test
C)   use the test on all people employed by the company in a similar job
D)   postpone hiring until the criterion is measured

Question 18

Which one of the following criteria used in educational settings is subjective?

Accepted Answer

A)   grade point average
B)   instructors' letters of recommendation
C)   number of dismissals or withdrawals
D)   number of courses completed

Question 19

When someone is interested in determining whether adding an additional test to an existing battery of tests makes good sense, we can say they are most likely interested in the ______.

Accepted Answer

A)   incremental validity of the test
B)   reliability/precision of the test
C)   face validity of the test
D)   content validity of the test

Question 20

Explain the concept and purpose of regression. Give an example of linear regression and an example of multiple regression.

Accepted Answer

The answer of Explain the concept and purpose of regression....

Exam 7: How Do We Gather Evidence of Validity Based on Testcriterion Relationships