Exam 7: How Do We Gather Evidence of Validity Based on Testcriterion Relationships

What are the important psychometric characteristics that a useful criterion must have? Explain your reasoning and give an example for each characteristic.

Define and give examples of objective and subjective criteria and explain why criteria must be reliable and valid.

When we are interested in predicting criterion (Y') from a set of test scores, we can use what statistical procedure?

When a calculated correlation is greater than the critical value shown in the table, we can infer that the probability of finding our correlation by chance is less than 5 chances of 100. Therefore, we assume that there is ______.

How much variance do a test and criterion share if the coefficient of determination is .09?

The coefficient of determination indicates what?

What do we call an evaluative standard that researchers use to measure performance, attitude, or motivation?

What is restriction of range and what causes it? Explain the consequences of restriction of range. Give an example.

Which of the following is TRUE about objective criteria?

Graduate students at a local college wanted to predict the probability of success for each first-year student. During the summer, they developed a multiple choice test with 50 items based on interviews from first-year students at the end of the previous year. When they asked permission to give the test to this year's students, the dean asked for evidence of test reliability and validity. The graduate students replied the test showed a coefficient alpha of .92 and that the test had evidence of validity based on content. The dean replied that validity evidence based on content validity was not good enough. The dean asked them to submit a plan for gathering evidence of validity based on the tests relations with some external criteria. Provide a plan for a validation study that the graduate students can give to the dean.

A subjective criterion is ______.

In the equation Y' = a + bX, what does a represent?

Which of the following statements is FALSE?

When test developers correlate test scores with the criterion scores, the resulting number is called the ______.

When it is important to show a relationship between test scores and a future behavior, researchers establish evidence of validity using what method?

Which one of the following indicates the expected change in Y for every one-unit change in X_i, when all the other predictors in the equation do not vary or remain constant?

In the equation Y' = a + bX, what does Y' represent?

In the equation Y' = a + bX, what does b represent?

What is criterion contamination? Give examples of criteria that may be contaminated.

In a regression equation, the intercept is the place where the ______.