Question 1

A researcher who used a self-report measure of job interest to predict performance on a managerial task would be interested in the _____ of her self-report measure.

Accepted Answer

A) predictive validity 
B) construct validity 
C) content validity 
D) face validity 
A) predictive validity 
B) construct validity 
C) content validity 
D) face validity A

Question 2

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair.Stanley should now worry about the __________ of his new measure.

Accepted Answer

A) discriminant validity 
B) face validity 
C) content validity 
D) predictive validity 
A) discriminant validity 
B) face validity 
C) content validity 
D) predictive validity A

Question 3

The Graduate Record Exam (GRE) uses which approach to assess reliability?

Accepted Answer

A) Interrater 
B) Equivalent forms 
C) Item to total 
D) Unexpected item 
A) Interrater 
B) Equivalent forms 
C) Item to total 
D) Unexpected item B

Question 4

Kappa is used

Accepted Answer

A) to test the construct validity of a measure. 
B) to test the criterion validity of a measure. 
C) to compute the reliability of a set of nominal variables. 
D) to eliminate items from a Likert scale. 
A) to test the construct validity of a measure. 
B) to test the criterion validity of a measure. 
C) to compute the reliability of a set of nominal variables. 
D) to eliminate items from a Likert scale.

Question 5

Which of the following is true about the difference between random and systematic error?

Accepted Answer

A) Random error is self-canceling, whereas systematic error tends to increase or decrease the scores on the measured variable. 
B) Random error tends to increase or decrease the scores on the dependent variable, whereas systematic error is self-canceling. 
C) Both random error and systematic error are self-canceling. 
D) Because systematic error is self-canceling, it is less problematic in research than is random error. 
A) Random error is self-canceling, whereas systematic error tends to increase or decrease the scores on the measured variable. 
B) Random error tends to increase or decrease the scores on the dependent variable, whereas systematic error is self-canceling. 
C) Both random error and systematic error are self-canceling. 
D) Because systematic error is self-canceling, it is less problematic in research than is random error.

Question 6

The major advantage of assessing similar conceptual relationships in many different studies is that

Accepted Answer

A) it reduces the need for the nomological net. 
B) random assignment is less important. 
C) a larger p-value can be used. 
D) the greater number of tested and confirmed predicted relationships, the greater the construct validity of the relationships. 
A) it reduces the need for the nomological net. 
B) random assignment is less important. 
C) a larger p-value can be used. 
D) the greater number of tested and confirmed predicted relationships, the greater the construct validity of the relationships.

Question 7

The reliability of a test refers to the extent that the test is free from

Accepted Answer

A) random error. 
B) measurement bias. 
C) systematic error. 
D) individual traits. 
A) random error. 
B) measurement bias. 
C) systematic error. 
D) individual traits.

Question 8

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility.Which of the following was found?

Accepted Answer

A) The new measure was more sophisticated. 
B) The new measure was better able to predict mobility. 
C) The HiJK correlated negatively with the existing measure. 
D) The HiJK was not reliable. 
A) The new measure was more sophisticated. 
B) The new measure was better able to predict mobility. 
C) The HiJK correlated negatively with the existing measure. 
D) The HiJK was not reliable.

Question 9

Reliability is used to assess _____________, whereas validity is used to assess _____________.

Accepted Answer

A) the consistency of a measure; the accuracy of a measure 
B) the accuracy of a measure; the consistency of a measure 
C) the generalizability of a measure; the reactance of a measure 
D) test reactance of a measure; the generalizability of a measure 
A) the consistency of a measure; the accuracy of a measure 
B) the accuracy of a measure; the consistency of a measure 
C) the generalizability of a measure; the reactance of a measure 
D) test reactance of a measure; the generalizability of a measure

Question 10

Cronbach's coefficient alpha is a measure of which of the following?

Accepted Answer

A) The internal consistency of a scale 
B) Test-retest reliability 
C) Interrater reliability 
D) Construct reliability 
A) The internal consistency of a scale 
B) Test-retest reliability 
C) Interrater reliability 
D) Construct reliability

Question 11

A test designed to measure baseball performance skills would be said to have high predictive validity if a person who scores low on the test also

Accepted Answer

A) scores low on a test measuring basketball performance. 
B) scores high on a test measuring basketball performance. 
C) has a poor batting average over the baseball season. 
D) scores high on the same test given two weeks later. 
A) scores low on a test measuring basketball performance. 
B) scores high on a test measuring basketball performance. 
C) has a poor batting average over the baseball season. 
D) scores high on the same test given two weeks later.

Question 12

.Hillyer and Joynes (2009) created a new measure of locomotion in rats.Which of the following approaches did they use to determine the reliability of the new measure.

Accepted Answer

A) Coefficient Alpha. 
B) Split half reliability 
C) Inter-rater reliability 
D) Test-retest reliability 
A) Coefficient Alpha. 
B) Split half reliability 
C) Inter-rater reliability 
D) Test-retest reliability

Question 13

A researcher has developed a new test of "interpersonal skills." It consists of measuring a person's shoe size.The test shows a test-retest reliability of .85.It appears that this test has __________ and ___________.

Accepted Answer

A) high reliability; high face validity 
B) high reliability; low face validity 
C) low reliability; high face validity 
D) low reliability; low face validity 
A) high reliability; high face validity 
B) high reliability; low face validity 
C) low reliability; high face validity 
D) low reliability; low face validity

Question 14

Which of the following two techniques can be used to assess the internal consistency of a scale?

Accepted Answer

A) Coefficient alpha, split-half reliability 
B) Coefficient alpha, test-retest reliability 
C) Test-retest reliability, equivalent forms reliability 
D) Test-retest reliability, split-half reliability 
A) Coefficient alpha, split-half reliability 
B) Coefficient alpha, test-retest reliability 
C) Test-retest reliability, equivalent forms reliability 
D) Test-retest reliability, split-half reliability

Question 15

Discriminant validity refers to

Accepted Answer

A) the extent to which a measured variable does not correlate with other variables designed to measure different conceptual variables. 
B) the extent to which a measured variable correlates with other measured variables designed to assess different conceptual variables. 
C) the extent to which a measured variable correlates with another measured variable over time. 
D) the extent to which a measured variable discriminates against other measured variables. 
A) the extent to which a measured variable does not correlate with other variables designed to measure different conceptual variables. 
B) the extent to which a measured variable correlates with other measured variables designed to assess different conceptual variables. 
C) the extent to which a measured variable correlates with another measured variable over time. 
D) the extent to which a measured variable discriminates against other measured variables.

Question 16

A scientist is interested in developing a scale to measure people's mood states.Which of the following forms of validity is likely to be most appropriate?

Accepted Answer

A) Test-retest 
B) Equivalent forms 
C) Internal consistency 
D) Content reliability 
A) Test-retest 
B) Equivalent forms 
C) Internal consistency 
D) Content reliability

Question 17

Errors in recording the scores on a test that occur because the keypuncher is not paying attention are likely to produce

Accepted Answer

A) spurious relationships. 
B) low face validity. 
C) random error. 
D) systematic error. 
A) spurious relationships. 
B) low face validity. 
C) random error. 
D) systematic error.

Question 18

A form of reliability that is used to assess the consistency of judgment when more than one person has observed a set of events is known as

Accepted Answer

A) judgment reliability. 
B) interrater reliability. 
C) construct reliability. 
D) internal reliability. 
A) judgment reliability. 
B) interrater reliability. 
C) construct reliability. 
D) internal reliability.

Question 19

Which of the following is an example of systematic error?

Accepted Answer

A) The participant misreads the question. 
B) The experimenter misprints the question. 
C) The participant forgets to answer a question. 
D) The participant displays socially desirable responding. 
A) The participant misreads the question. 
B) The experimenter misprints the question. 
C) The participant forgets to answer a question. 
D) The participant displays socially desirable responding.

Question 20

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car.One might criticize this test for having low

Accepted Answer

A) content validity. 
B) criterion validity. 
C) predictive validity. 
D) discriminant validity. 
A) content validity. 
B) criterion validity. 
C) predictive validity. 
D) discriminant validity.

A researcher who used a self-report measure of job interest to predict performance on a managerial task would be interested in the _____ of her self-report measure.

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair.Stanley should now worry about the __________ of his new measure.

The Graduate Record Exam (GRE) uses which approach to assess reliability?

Kappa is used

Which of the following is true about the difference between random and systematic error?

The major advantage of assessing similar conceptual relationships in many different studies is that

The reliability of a test refers to the extent that the test is free from

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility.Which of the following was found?

Reliability is used to assess _, whereas validity is used to assess _.

Cronbach's coefficient alpha is a measure of which of the following?

A test designed to measure baseball performance skills would be said to have high predictive validity if a person who scores low on the test also

.Hillyer and Joynes (2009) created a new measure of locomotion in rats.Which of the following approaches did they use to determine the reliability of the new measure.

A researcher has developed a new test of "interpersonal skills." It consists of measuring a person's shoe size.The test shows a test-retest reliability of .85.It appears that this test has and _.

Which of the following two techniques can be used to assess the internal consistency of a scale?

Discriminant validity refers to

A scientist is interested in developing a scale to measure people's mood states.Which of the following forms of validity is likely to be most appropriate?

Errors in recording the scores on a test that occur because the keypuncher is not paying attention are likely to produce

A form of reliability that is used to assess the consistency of judgment when more than one person has observed a set of events is known as

Which of the following is an example of systematic error?

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car.One might criticize this test for having low

Introduction to Research and Research Designs

The Research Hypothesis

Ethics in Research

Measures

Surveys and Sampling

Naturalistic Methods

Hypothesis Testing and Inferential Statistics

Correlational Research Designs

Experimental Research: One-Way Designs

Experimental Research: Factorial Designs

Experimental Control and Internal Validity

External Validity

Quasi-Experimental Research Designs

Reporting Research Results

Data Preparation and Univariate Statistics

Bivariate Statistics

Multivariate Statistics

Filters

Exam 5: Reliability and Validity

A researcher who used a self-report measure of job interest to predict performance on a managerial task would be interested in the _____ of her self-report measure.

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair.Stanley should now worry about the __________ of his new measure.

The Graduate Record Exam (GRE) uses which approach to assess reliability?

Kappa is used

Which of the following is true about the difference between random and systematic error?

The major advantage of assessing similar conceptual relationships in many different studies is that

The reliability of a test refers to the extent that the test is free from

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility.Which of the following was found?

Reliability is used to assess _____________, whereas validity is used to assess _____________.

Cronbach's coefficient alpha is a measure of which of the following?

A test designed to measure baseball performance skills would be said to have high predictive validity if a person who scores low on the test also

.Hillyer and Joynes (2009) created a new measure of locomotion in rats.Which of the following approaches did they use to determine the reliability of the new measure.

A researcher has developed a new test of "interpersonal skills." It consists of measuring a person's shoe size.The test shows a test-retest reliability of .85.It appears that this test has __________ and ___________.

Which of the following two techniques can be used to assess the internal consistency of a scale?

Discriminant validity refers to

A scientist is interested in developing a scale to measure people's mood states.Which of the following forms of validity is likely to be most appropriate?

Errors in recording the scores on a test that occur because the keypuncher is not paying attention are likely to produce

A form of reliability that is used to assess the consistency of judgment when more than one person has observed a set of events is known as

Which of the following is an example of systematic error?

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car.One might criticize this test for having low

Introduction to Research and Research Designs

The Research Hypothesis

Ethics in Research

Measures

Surveys and Sampling

Naturalistic Methods

Hypothesis Testing and Inferential Statistics

Correlational Research Designs

Experimental Research: One-Way Designs

Experimental Research: Factorial Designs

Experimental Control and Internal Validity

External Validity

Quasi-Experimental Research Designs

Reporting Research Results

Data Preparation and Univariate Statistics

Bivariate Statistics

Multivariate Statistics

Filters

Reliability is used to assess _, whereas validity is used to assess _.

A researcher has developed a new test of "interpersonal skills." It consists of measuring a person's shoe size.The test shows a test-retest reliability of .85.It appears that this test has and _.