Question 1

Which of the following would be likely to improve the reliability and validity of a measure?

Accepted Answer

A)  Using only one measure to assess the conceptual variable 
B)  Reducing the number of questions on the test 
C)  Using pilot testing to select good questions 
D)  Decreasing the variability of measures 
A)  Using only one measure to assess the conceptual variable 
B)  Reducing the number of questions on the test 
C)  Using pilot testing to select good questions 
D)  Decreasing the variability of measures

Question 2

A researcher has found that his new measure designed to assess the conceptual variable of "exoticism" correlates about +.85 with an existing measure designed to assess "unusualness." The researcher needs to worry about the __________ of his measure.

Accepted Answer

A)  random error 
B)  measurement bias 
C)  face validity 
D)  discriminant validity 
A)  random error 
B)  measurement bias 
C)  face validity 
D)  discriminant validity

Question 3

If it is found that people's self-esteem changes quickly-for instance, from day to day-then self-esteem should be considered to be

Accepted Answer

A)  a trait variable. 
B)  a state variable. 
C)  an unreliable variable. 
D)  an invalid variable. 
A)  a trait variable. 
B)  a state variable. 
C)  an unreliable variable. 
D)  an invalid variable.

Question 4

Consider the following item that might appear on a Likert scale: "I normally do not get along well with other people." Such an item has high __________ validity, but may not have __________ validity because respondents may not answer it honestly.

Accepted Answer

A)  face; construct 
B)  construct; face 
C)  face; criterion 
D)  construct; criterion 
A)  face; construct 
B)  construct; face 
C)  face; criterion 
D)  construct; criterion

Question 5

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility. Which of the following was found?

Accepted Answer

A)  The new measure was more sophisticated. 
B)  The new measure was better able to predict mobility. 
C)  The HiJK correlated negatively with the existing measure. 
D)  The HiJK was not reliable. 
A)  The new measure was more sophisticated. 
B)  The new measure was better able to predict mobility. 
C)  The HiJK correlated negatively with the existing measure. 
D)  The HiJK was not reliable.

Question 6

Cronbach's coefficient alpha is a measure of which of the following?

Accepted Answer

A)  The internal consistency of a scale 
B)  Test-retest reliability 
C)  Interrater reliability 
D)  Construct reliability 
A)  The internal consistency of a scale 
B)  Test-retest reliability 
C)  Interrater reliability 
D)  Construct reliability

Question 7

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car. One might criticize this test for having low

Accepted Answer

A)  content validity. 
B)  criterion validity. 
C)  predictive validity. 
D)  discriminant validity. 
A)  content validity. 
B)  criterion validity. 
C)  predictive validity. 
D)  discriminant validity.

Question 8

Discriminant validity refers to

Accepted Answer

A)  the extent to which a measured variable does not correlate with other variables designed to measure different conceptual variables. 
B)  the extent to which a measured variable correlates with other measured variables designed to assess different conceptual variables. 
C)  the extent to which a measured variable correlates with another measured variable over time. 
D)  the extent to which a measured variable discriminates against other measured variables. 
A)  the extent to which a measured variable does not correlate with other variables designed to measure different conceptual variables. 
B)  the extent to which a measured variable correlates with other measured variables designed to assess different conceptual variables. 
C)  the extent to which a measured variable correlates with another measured variable over time. 
D)  the extent to which a measured variable discriminates against other measured variables.

Question 9

Andrea is given a questionnaire concerning her shopping habits. Two weeks later, she is given a similar questionnaire that also assesses shopping habits, but which contains different questions. The researcher will likely assess which of the following?

Accepted Answer

A)  interrater reliability 
B)  equivalent-forms reliability 
C)  face validity 
D)  construct validity 
A)  interrater reliability 
B)  equivalent-forms reliability 
C)  face validity 
D)  construct validity

Question 10

The major advantage of assessing similar conceptual relationships in many different studies is that

Accepted Answer

A)  it reduces the need for the nomological net. 
B)  random assignment is less important. 
C)  a larger p-value can be used. 
D)  the greater number of tested and confirmed predicted relationships, the greater the construct validity of the relationships. 
A)  it reduces the need for the nomological net. 
B)  random assignment is less important. 
C)  a larger p-value can be used. 
D)  the greater number of tested and confirmed predicted relationships, the greater the construct validity of the relationships.

Question 11

Cronbach's coefficient alpha is a measure of which of the following?

Accepted Answer

A)  The average validity of an item 
B)  The correlation between one item and the total scale score 
C)  The average correlation among the items 
D)  The face validity of a scale 
A)  The average validity of an item 
B)  The correlation between one item and the total scale score 
C)  The average correlation among the items 
D)  The face validity of a scale

Question 12

Which of the following is true about the difference between random and systematic error?

Accepted Answer

A)  Random error is self-canceling, whereas systematic error tends to increase or decrease the scores on the measured variable. 
B)  Random error tends to increase or decrease the scores on the dependent variable, whereas systematic error is self-canceling. 
C)  Both random error and systematic error are self-canceling. 
D)  Because systematic error is self-canceling, it is less problematic in research than is random error. 
A)  Random error is self-canceling, whereas systematic error tends to increase or decrease the scores on the measured variable. 
B)  Random error tends to increase or decrease the scores on the dependent variable, whereas systematic error is self-canceling. 
C)  Both random error and systematic error are self-canceling. 
D)  Because systematic error is self-canceling, it is less problematic in research than is random error.

Question 13

Which of the following two techniques can be used to assess the internal consistency of a scale?

Accepted Answer

A)  Coefficient alpha, split-half reliability 
B)  Coefficient alpha, test-retest reliability 
C)  Test-retest reliability, equivalent forms reliability 
D)  Test-retest reliability, split-half reliability 
A)  Coefficient alpha, split-half reliability 
B)  Coefficient alpha, test-retest reliability 
C)  Test-retest reliability, equivalent forms reliability 
D)  Test-retest reliability, split-half reliability

Question 14

If the average correlation among the items on a scale of self-esteem is r = .15, we can say that the scale has

Accepted Answer

A)  high content validity. 
B)  low internal consistency. 
C)  high internal consistency. 
D)  high construct validity. 
A)  high content validity. 
B)  low internal consistency. 
C)  high internal consistency. 
D)  high construct validity.

Question 15

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair. Stanley should now worry about the __________ of his new measure.

Accepted Answer

A)  discriminant validity 
B)  face validity 
C)  content validity 
D)  predictive validity 
A)  discriminant validity 
B)  face validity 
C)  content validity 
D)  predictive validity

Question 16

A researcher is developing a Likert scale to measure the self-esteem of a group of college students. He considers self-esteem to be a state, in the sense that it will change from day to day based on a person's experiences. Which of the following forms of reliability should he use to assess self-esteem?

Accepted Answer

A)  Internal consistency 
B)  Interrater 
C)  Test-retest 
D)  Equivalent forms 
A)  Internal consistency 
B)  Interrater 
C)  Test-retest 
D)  Equivalent forms

Question 17

Kappa is used

Accepted Answer

A)  to test the construct validity of a measure. 
B)  to test the criterion validity of a measure. 
C)  to compute the reliability of a set of nominal variables. 
D)  to eliminate items from a Likert scale. 
A)  to test the construct validity of a measure. 
B)  to test the criterion validity of a measure. 
C)  to compute the reliability of a set of nominal variables. 
D)  to eliminate items from a Likert scale.

Question 18

In order to better understand how individuals react to a questionnaire before using the questionnaire in a research project, the researcher may wish to

Accepted Answer

A)  pilot test. 
B)  compute coefficient alpha. 
C)  compute kappa. 
D)  delete all distractor items from the scale. 
A)  pilot test. 
B)  compute coefficient alpha. 
C)  compute kappa. 
D)  delete all distractor items from the scale.

Question 19

Which of the following equations represents the relationship between true score, actual score, and reliability?

Accepted Answer

A)  Reliability equals true score divided by actual score. 
B)  Reliability equals true score plus actual score. 
C)  Reliability equals actual score divided by true score. 
D)  Reliability equals actual score minus true score. 
A)  Reliability equals true score divided by actual score. 
B)  Reliability equals true score plus actual score. 
C)  Reliability equals actual score divided by true score. 
D)  Reliability equals actual score minus true score.

Question 20

Which of the following is a correct statement?

Accepted Answer

A)  A scale must be reliable in order to have construct validity. 
B)  A scale must have construct validity in order to be reliable. 
C)  A scale must have face validity in order to be reliable. 
D)  A scale must be reliable in order to have face validity. 
A)  A scale must be reliable in order to have construct validity. 
B)  A scale must have construct validity in order to be reliable. 
C)  A scale must have face validity in order to be reliable. 
D)  A scale must be reliable in order to have face validity.

Which of the following would be likely to improve the reliability and validity of a measure?

A researcher has found that his new measure designed to assess the conceptual variable of "exoticism" correlates about +.85 with an existing measure designed to assess "unusualness." The researcher needs to worry about the __________ of his measure.

If it is found that people's self-esteem changes quickly-for instance, from day to day-then self-esteem should be considered to be

Consider the following item that might appear on a Likert scale: "I normally do not get along well with other people." Such an item has high validity, but may not have validity because respondents may not answer it honestly.

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility. Which of the following was found?

Cronbach's coefficient alpha is a measure of which of the following?

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car. One might criticize this test for having low

Discriminant validity refers to

Andrea is given a questionnaire concerning her shopping habits. Two weeks later, she is given a similar questionnaire that also assesses shopping habits, but which contains different questions. The researcher will likely assess which of the following?

The major advantage of assessing similar conceptual relationships in many different studies is that

Cronbach's coefficient alpha is a measure of which of the following?

Which of the following is true about the difference between random and systematic error?

Which of the following two techniques can be used to assess the internal consistency of a scale?

If the average correlation among the items on a scale of self-esteem is r = .15, we can say that the scale has

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair. Stanley should now worry about the __________ of his new measure.

Kappa is used

In order to better understand how individuals react to a questionnaire before using the questionnaire in a research project, the researcher may wish to

Which of the following equations represents the relationship between true score, actual score, and reliability?

Which of the following is a correct statement?

Introduction to Research

Developing the Research Hypothesis

Ethics in Research

Measures

Surveys and Sampling

Naturalistic Methods

Hypothesis Testing and Inferential Statistics

Correlational Research Designs

Experimental Research: One-Way Designs

Experimental Research: Factorial Designs

Experimental Control and Internal Validity

External Validity

Quasi-Experimental Research Designs

Reporting Research Results

Data Preparation and Univariate Statistics

Bivariate Statistics

Multivariate Statistics

Filters

Exam 5: Reliability and Validity

Which of the following would be likely to improve the reliability and validity of a measure?

A researcher has found that his new measure designed to assess the conceptual variable of "exoticism" correlates about +.85 with an existing measure designed to assess "unusualness." The researcher needs to worry about the __________ of his measure.

If it is found that people's self-esteem changes quickly-for instance, from day to day-then self-esteem should be considered to be

Consider the following item that might appear on a Likert scale: "I normally do not get along well with other people." Such an item has high __________ validity, but may not have __________ validity because respondents may not answer it honestly.

In the study by Hillkyer and Joynes (1995) on locomotion in rats, the researchers tested for productive validity by correlating an existing measures (the BBB) and a new measure (the HUK) with a physiological assessment of mobility. Which of the following was found?

Cronbach's coefficient alpha is a measure of which of the following?

Consider a researcher who developed a test of driving skills that involved measuring the ability to effectively shift gears in a manual transmission car. One might criticize this test for having low

Discriminant validity refers to

Andrea is given a questionnaire concerning her shopping habits. Two weeks later, she is given a similar questionnaire that also assesses shopping habits, but which contains different questions. The researcher will likely assess which of the following?

The major advantage of assessing similar conceptual relationships in many different studies is that

Cronbach's coefficient alpha is a measure of which of the following?

Which of the following is true about the difference between random and systematic error?

Which of the following two techniques can be used to assess the internal consistency of a scale?

If the average correlation among the items on a scale of self-esteem is r = .15, we can say that the scale has

Stanley developed a measure of hopefulness that correlates about -.90 with a measure of despair. Stanley should now worry about the __________ of his new measure.

Kappa is used

In order to better understand how individuals react to a questionnaire before using the questionnaire in a research project, the researcher may wish to

Which of the following equations represents the relationship between true score, actual score, and reliability?

Which of the following is a correct statement?

Introduction to Research

Developing the Research Hypothesis

Ethics in Research

Measures

Surveys and Sampling

Naturalistic Methods

Hypothesis Testing and Inferential Statistics

Correlational Research Designs

Experimental Research: One-Way Designs

Experimental Research: Factorial Designs

Experimental Control and Internal Validity

External Validity

Quasi-Experimental Research Designs

Reporting Research Results

Data Preparation and Univariate Statistics

Bivariate Statistics

Multivariate Statistics

Filters

Consider the following item that might appear on a Likert scale: "I normally do not get along well with other people." Such an item has high validity, but may not have validity because respondents may not answer it honestly.