Deck 5: Identifying Good Measurement
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Unlock Deck
Sign up to unlock the cards in this deck!
Unlock Deck
Unlock Deck
1/65
Play
Full screen (f)
Deck 5: Identifying Good Measurement
1
Which of the following is true of operational definitions?
A)There is only one operational definition that is possible for each conceptual definition.
B)The specification of operational definitions is one of the creative aspects of the research process.
C)Conceptual definitions are created after operational definitions are determined.
D)Operational definitions and conceptual definitions are the same thing.
A)There is only one operational definition that is possible for each conceptual definition.
B)The specification of operational definitions is one of the creative aspects of the research process.
C)Conceptual definitions are created after operational definitions are determined.
D)Operational definitions and conceptual definitions are the same thing.
The specification of operational definitions is one of the creative aspects of the research process.
2
A correlation-based statistic called is commonly used to determine internal reliability.
A)Cronbach's alpha
B)kappa
C)a scatterplot
D)Pearson's r
A)Cronbach's alpha
B)kappa
C)a scatterplot
D)Pearson's r
Cronbach's alpha
3
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Dr) Rodriquez is concerned about the validity of the measure of narcissism recommended by her colleague. She sends a copy of the measure to the faculty members in her psychology department to look at, and they all tell her it looks like it will measure narcissism. She now has evidence of which of the following?
A)Content validity
B)Face validity
C)Discriminant validity
D)Concurrent validity
Dr) Rodriquez is concerned about the validity of the measure of narcissism recommended by her colleague. She sends a copy of the measure to the faculty members in her psychology department to look at, and they all tell her it looks like it will measure narcissism. She now has evidence of which of the following?
A)Content validity
B)Face validity
C)Discriminant validity
D)Concurrent validity
Face validity
4
Todd is studying the effect of popularity on academic success for his research methods project. He decides to measure popularity by asking each elementary school student to tell him how many friends he or she has. He assumes that more friends means the student is more popular. Which of the following best describes this variable?
A)A ratio scale of measurement
B)A qualitative variable
C)An other-report measure
D)A categorical variable
A)A ratio scale of measurement
B)A qualitative variable
C)An other-report measure
D)A categorical variable
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
5
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Before using the measure in her study, Dr. Rodriquez gives the measure to a group of participants on the first day of the semester and again on the last day of the semester. Dr. Rodriquez is examining the scatterplot of the data she collected on the first day of the semester and the last day of the semester. On the scatterplot, she sees that the dots are very close to forming a diagonal line. This indicates which of the following?
A)A strong relationship
B)A nonrelationship
C)A valid finding
D)A negative finding
Before using the measure in her study, Dr. Rodriquez gives the measure to a group of participants on the first day of the semester and again on the last day of the semester. Dr. Rodriquez is examining the scatterplot of the data she collected on the first day of the semester and the last day of the semester. On the scatterplot, she sees that the dots are very close to forming a diagonal line. This indicates which of the following?
A)A strong relationship
B)A nonrelationship
C)A valid finding
D)A negative finding
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
6
For his research methods class, Felipe plans to watch how students treat other children in their classrooms who have attention-deficit/hyperactivity disorder (ADHD). He will evaluate how positively or negatively the children are treated by their classmates. This is an example of what type of measurement?
A)Self-report measurement
B)Observational measurement
C)Physiological measurement
D)Archival measurement
A)Self-report measurement
B)Observational measurement
C)Physiological measurement
D)Archival measurement
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
7
What is the difference between a ratio scale of measurement and an interval scale of measurement?
A)A ratio scale of measurement has a zero value that actually means "nothing" or "the absence of something," but an interval scale does not.
B)An interval scale of measurement is a type of measurement used for categorical measurements, but a ratio scale is used for quantitative measurements.
C)An interval scale has equal intervals, but a ratio scale does not.
D)A ratio scale of measurement cannot be used to compare people's scores, but interval scales can (e.g., Phillip is twice as fast).
A)A ratio scale of measurement has a zero value that actually means "nothing" or "the absence of something," but an interval scale does not.
B)An interval scale of measurement is a type of measurement used for categorical measurements, but a ratio scale is used for quantitative measurements.
C)An interval scale has equal intervals, but a ratio scale does not.
D)A ratio scale of measurement cannot be used to compare people's scores, but interval scales can (e.g., Phillip is twice as fast).
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
8
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Dr) Rodriquez is concerned whether her measure will really measure narcissism or if it will measure some other related concept. She is concerned about the scale's .
A)operational definition
B)validity
C)reliability
D)convenience
Dr) Rodriquez is concerned whether her measure will really measure narcissism or if it will measure some other related concept. She is concerned about the scale's .
A)operational definition
B)validity
C)reliability
D)convenience
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
9
Hosea is studying the relationship between caffeine consumption and problem-solving ability. Which of the following is a quantitative way to operationalize problem-solving ability?
A)The time spent solving a math problem
B)The type of puzzle solved (Sudoku puzzle or a crossword puzzle)
C)Whether participants used insight or trial-and-error techniques to solve the problem
D)The report of a teacher about whether a student is a good or bad problem solver
A)The time spent solving a math problem
B)The type of puzzle solved (Sudoku puzzle or a crossword puzzle)
C)Whether participants used insight or trial-and-error techniques to solve the problem
D)The report of a teacher about whether a student is a good or bad problem solver
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
10
Hosea is studying the relationship between caffeine consumption and problem-solving ability. Which of the following is a categorical way to operationalize caffeine consumption?
A)The number of cups of coffee consumed in a day
B)The number of milligrams of caffeine consumed during the study
C)The frequency of buying energy drinks
D)Whether the participant drank a soda in the 24 hours prior to the study
A)The number of cups of coffee consumed in a day
B)The number of milligrams of caffeine consumed during the study
C)The frequency of buying energy drinks
D)Whether the participant drank a soda in the 24 hours prior to the study
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
11
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Before using the measure in her study, Dr. Rodriquez gives the measure to a group of participants on the first day of the semester and again on the last day of the semester. She then compares the scores between the two time points. This is a test of which of the following?
A)Interrater reliability
B)Internal reliability
C)Test-retest reliability
D)Construct reliability
Before using the measure in her study, Dr. Rodriquez gives the measure to a group of participants on the first day of the semester and again on the last day of the semester. She then compares the scores between the two time points. This is a test of which of the following?
A)Interrater reliability
B)Internal reliability
C)Test-retest reliability
D)Construct reliability
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
12
Which types of reliability can be analyzed with scatterplots?
A)All types of reliability
B)Internal reliability and test-retest reliability
C)Internal reliability and interrater reliability
D)Interrater reliability and test-retest reliability
A)All types of reliability
B)Internal reliability and test-retest reliability
C)Internal reliability and interrater reliability
D)Interrater reliability and test-retest reliability
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
13
For her research methods class, Serena plans to interview several teachers about their attitude toward teaching children who have attention-deficit/hyperactivity disorder (ADHD). This is an example of what type of measurement?
A)Self-report measurement
B)Observational measurement
C)Physiological measurement
D)Archival measurement
A)Self-report measurement
B)Observational measurement
C)Physiological measurement
D)Archival measurement
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
14
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Before using the measure in her study, Dr. Rodriquez analyzes the data she gets from her students. She looks at the relationship between each of the individual questions. She sees that participants who agree with Question 1 also agree with Question 3 and disagree with Question 2. This is a test of which of the following?
A)Interrater reliability
B)Internal reliability
C)Test-retest reliability
D)Construct reliability
Before using the measure in her study, Dr. Rodriquez analyzes the data she gets from her students. She looks at the relationship between each of the individual questions. She sees that participants who agree with Question 1 also agree with Question 3 and disagree with Question 2. This is a test of which of the following?
A)Interrater reliability
B)Internal reliability
C)Test-retest reliability
D)Construct reliability
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
15
Which of the following is NOT an example of physiological measurement?
A)Measurements of hormones in the bloodstream
B)Blood pressure measurements
C)Number of panic attacks a patient reports
D)A brain scan made using an fMRI
A)Measurements of hormones in the bloodstream
B)Blood pressure measurements
C)Number of panic attacks a patient reports
D)A brain scan made using an fMRI
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
16
How many subcategories of quantitative variables exist?
A)Two
B)Three
C)Four
D)Five
A)Two
B)Three
C)Four
D)Five
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
17
Naomi is studying the effect of popularity on academic success for her research methods project. To do this, she has elementary school students rate how popular each member of their class is. She then uses this information to rank the students on popularity (e.g., John is the most popular, Vanessa is the second-most popular). Which of the following best describes this variable?
A)An ordinal scale of measurement
B)A self-report measurement
C)A categorical measurement
D)An interval scale of measurement
A)An ordinal scale of measurement
B)A self-report measurement
C)A categorical measurement
D)An interval scale of measurement
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
18
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Dr) Rodriquez calculates a correlation coefficient (r) to examine the relationship between Question 1 and Question 2 and between Question 1 and Question 3. She finds a correlation coefficient of r = −0.73 between Questions 1 and 2 and a correlation coefficient of r = 0.74 between Questions 1 and 3. Which of the following is true of her findings?
A)There appears to be good internal reliability in the scale.
B)The correlation between Questions 1 and 2 and Questions 1 and 3 are in the same direction.
C)The correlation between Questions 1 and 2 is much weaker than between Questions 1 and 3.
D)The negative correlation between Questions 1 and 2 is bad for Dr. Rodriquez.
Dr) Rodriquez calculates a correlation coefficient (r) to examine the relationship between Question 1 and Question 2 and between Question 1 and Question 3. She finds a correlation coefficient of r = −0.73 between Questions 1 and 2 and a correlation coefficient of r = 0.74 between Questions 1 and 3. Which of the following is true of her findings?
A)There appears to be good internal reliability in the scale.
B)The correlation between Questions 1 and 2 and Questions 1 and 3 are in the same direction.
C)The correlation between Questions 1 and 2 is much weaker than between Questions 1 and 3.
D)The negative correlation between Questions 1 and 2 is bad for Dr. Rodriquez.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
19
Asking many similar questions when trying to measure a concept is done to:
A)ensure validity.
B)cancel out measurement error.
C)make sure participants are not lying.
D)allow participants to skip questions.
A)ensure validity.
B)cancel out measurement error.
C)make sure participants are not lying.
D)allow participants to skip questions.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
20
RESEARCH STUDY 5.1: Dr. Rodriquez is considering conducting a study examining whether narcissistic people have poorer romantic relationships than those who are not narcissistic. One of her first tasks is to determine which of her participants are narcissistic and which are not. She decides to use the scale created by a colleague, the Donal scale. Question 1 reads, "I tend not to think about other people as much as I think about myself." Question 2 reads, "I do not have a high opinion of myself." Question 3 reads, "I think other people think I am really special."
Dr) Rodriquez decides to test the internal reliability of her measure. Which of the following results would make her happy?
A)↑ = 0.10
B)↑ = −0.03
C)↑ = 0.95
D)↑ = −0.98
Dr) Rodriquez decides to test the internal reliability of her measure. Which of the following results would make her happy?
A)↑ = 0.10
B)↑ = −0.03
C)↑ = 0.95
D)↑ = −0.98
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
21
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
Dr) Sheffield gives his measure to his supervisor, who is also an expert in pathological gambling. His supervisor says that his measure appears to test all the components of pathological gambling, including feeling restless when attempting to stop gambling, jeopardizing jobs in order to keep gambling, and using gambling to escape from problems and a bad mood. Given this information, Dr. Sheffield's measure has evidence of which of the following?
A)Content validity
B)Predictive validity
C)Criterion validity
D)Discriminant validity
Dr) Sheffield gives his measure to his supervisor, who is also an expert in pathological gambling. His supervisor says that his measure appears to test all the components of pathological gambling, including feeling restless when attempting to stop gambling, jeopardizing jobs in order to keep gambling, and using gambling to escape from problems and a bad mood. Given this information, Dr. Sheffield's measure has evidence of which of the following?
A)Content validity
B)Predictive validity
C)Criterion validity
D)Discriminant validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
22
What does it mean that "reliability is necessary but not sufficient for validity"?
A)If a measure is reliable, it is also valid.
B)If a measure is valid, it is also reliable.
C)Reliability and validity are unrelated concepts.
D)Reliability and validity are the same concept.
A)If a measure is reliable, it is also valid.
B)If a measure is valid, it is also reliable.
C)Reliability and validity are unrelated concepts.
D)Reliability and validity are the same concept.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
23
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
Dr) Sheffield decides to test the criterion validity of his measure. Dr. Sheffield gives his measure to a group of people that includes suspected problem gamblers and non-gamblers. Which of the following options below could he also do to get evidence for criterion validity?
A)Give the measure to a group of people attending Gamblers Anonymous meetings
B)Correlate the measure with a behavior, such as amount of money lost in a casino during the past year
C)Ask the participants to give their opinion on whether the measure is valid
D)Give a measure of alcohol addiction to the same group of clients
Dr) Sheffield decides to test the criterion validity of his measure. Dr. Sheffield gives his measure to a group of people that includes suspected problem gamblers and non-gamblers. Which of the following options below could he also do to get evidence for criterion validity?
A)Give the measure to a group of people attending Gamblers Anonymous meetings
B)Correlate the measure with a behavior, such as amount of money lost in a casino during the past year
C)Ask the participants to give their opinion on whether the measure is valid
D)Give a measure of alcohol addiction to the same group of clients
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
24
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
Dr) Sheffield wants to establish the discriminant validity of his pathological gambling measure. He gives his measure and three others to a group of 100 people. Which of the following provides the best evidence for discriminant validity?
A)That his measure is not strongly correlated with a measure of impulsivity
B)That his measure is not strongly correlated with the number of friends people have
C)That his measure is strongly correlated with a measure of alcohol addiction
D)That his measure is strongly correlated with a measure of self-esteem
Dr) Sheffield wants to establish the discriminant validity of his pathological gambling measure. He gives his measure and three others to a group of 100 people. Which of the following provides the best evidence for discriminant validity?
A)That his measure is not strongly correlated with a measure of impulsivity
B)That his measure is not strongly correlated with the number of friends people have
C)That his measure is strongly correlated with a measure of alcohol addiction
D)That his measure is strongly correlated with a measure of self-esteem
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
25
Why are convergent and discriminant validity often evaluated together?
A)Both terms mean the same thing.
B)Both involve collecting information from a lot of psychological measures of theoretical interest.
C)Both require the use of scatterplots.
D)Both have to be determined by a panel of experts.
A)Both terms mean the same thing.
B)Both involve collecting information from a lot of psychological measures of theoretical interest.
C)Both require the use of scatterplots.
D)Both have to be determined by a panel of experts.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
26
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
Dr) Sheffield has decided to test the discriminant validity of his new measure. He has a group of first-time Gamblers Anonymous (GA) attendants complete his measure and finds that they score higher than a group of people who do not attend the group. Which of the following results would provide evidence for discriminant validity?
A)He finds that the GA attendees score higher on his measure than the non-GA attendees.
B)He finds that the measure of gambling is not correlated with a measure of life satisfaction in the same two groups of people.
C)He finds that more recent GA joiners score higher than veteran GA attendees, who are more recovered.
D)He finds that the measure he used is also associated with people's past diagnoses of pathological gambling.
Dr) Sheffield has decided to test the discriminant validity of his new measure. He has a group of first-time Gamblers Anonymous (GA) attendants complete his measure and finds that they score higher than a group of people who do not attend the group. Which of the following results would provide evidence for discriminant validity?
A)He finds that the GA attendees score higher on his measure than the non-GA attendees.
B)He finds that the measure of gambling is not correlated with a measure of life satisfaction in the same two groups of people.
C)He finds that more recent GA joiners score higher than veteran GA attendees, who are more recovered.
D)He finds that the measure he used is also associated with people's past diagnoses of pathological gambling.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
27
Establishing construct validity is most important for which of the following?
A)A concrete construct
B)A behavior that is directly observable
C)Physical measurements (e.g., length)
D)An abstract concept
A)A concrete construct
B)A behavior that is directly observable
C)Physical measurements (e.g., length)
D)An abstract concept
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
28
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
Dr) Sheffield has now decided that he wants to test his measure on some university students (who some estimates say have a 6% prevalence rate of compulsive gambling). He has a group of 100 university students complete his measure. He also has them complete two other measures (one that measures addictive behavior in general and one that measures general attitudes toward gambling). He finds that his new measure is positively associated with each of these other measures. This procedure has provided evidence for the of Dr. Sheffield's measure.
A)content validity
B)predictive validity
C)convergent validity
D)discriminant validity
Dr) Sheffield has now decided that he wants to test his measure on some university students (who some estimates say have a 6% prevalence rate of compulsive gambling). He has a group of 100 university students complete his measure. He also has them complete two other measures (one that measures addictive behavior in general and one that measures general attitudes toward gambling). He finds that his new measure is positively associated with each of these other measures. This procedure has provided evidence for the of Dr. Sheffield's measure.
A)content validity
B)predictive validity
C)convergent validity
D)discriminant validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
29
Another word for discriminant validity is validity.
A)convergent
B)asymmetrical
C)divergent
D)multiple
A)convergent
B)asymmetrical
C)divergent
D)multiple
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
30
In interrogating the construct validity of a measure, which question should a researcher ask?
A)Is there enough evidence that this measure is valid?
B)Do I know that this measure is valid?
C)Does this measure have the right kind of validity?
D)Has an expert said that this measure is valid?
A)Is there enough evidence that this measure is valid?
B)Do I know that this measure is valid?
C)Does this measure have the right kind of validity?
D)Has an expert said that this measure is valid?
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
31
Establishing construct validity would probably be most important for which of the following?
A)A measure of heart rate
B)A measure of the number of times a person eats alone during a month
C)A measure of spirituality
D)A measure of income
A)A measure of heart rate
B)A measure of the number of times a person eats alone during a month
C)A measure of spirituality
D)A measure of income
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
32
In which of the following ways are content and face validity similar?
A)Both involve subjective judgments.
B)Both involve asking participants for their opinions about the measurement.
C)Both are preferred by psychologists as ideal measures of validity.
D)Both are very difficult to establish.
A)Both involve subjective judgments.
B)Both involve asking participants for their opinions about the measurement.
C)Both are preferred by psychologists as ideal measures of validity.
D)Both are very difficult to establish.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
33
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
To test his measure, Dr. Sheffield gives his measure to a group of his clients and at the same time measures how many times they have been gambling in the past month. He predicts that clients who score higher on his measure will also report gambling more times in the past month. This procedure is meant to provide evidence for which of the following?
A)Face validity
B)Content validity
C)Criterion validity
D)Discriminant validity
To test his measure, Dr. Sheffield gives his measure to a group of his clients and at the same time measures how many times they have been gambling in the past month. He predicts that clients who score higher on his measure will also report gambling more times in the past month. This procedure is meant to provide evidence for which of the following?
A)Face validity
B)Content validity
C)Criterion validity
D)Discriminant validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
34
Which of the following is NOT possible?
A)A measure is neither reliable nor valid.
B)A measure is both valid and reliable.
C)A measure is reliable but not valid.
D)A measure is valid but not reliable.
A)A measure is neither reliable nor valid.
B)A measure is both valid and reliable.
C)A measure is reliable but not valid.
D)A measure is valid but not reliable.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
35
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
If Dr. Sheffield's measure does not actually measure pathological gambling, his measure is said to lack which of the following?
A)Validity
B)Reliability
C)Conceptualization
D)Operationalization
If Dr. Sheffield's measure does not actually measure pathological gambling, his measure is said to lack which of the following?
A)Validity
B)Reliability
C)Conceptualization
D)Operationalization
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
36
According to its conceptual definition, a variable should be related to a particular behavior. If a researcher is able to demonstrate that his measure of the variable is related to the behavior, then he has established which of the following?
A)Discriminant validity
B)Content validity
C)Convergent validity
D)Criterion validity
A)Discriminant validity
B)Content validity
C)Convergent validity
D)Criterion validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
37
An educational psychologist is testing the discriminant validity of a new measure of numerical learning difficulties. He gives his measure to a group of students along with another measure of verbal learning difficulties, which he predicts should not be strongly related to numerical learning difficulties. Which of the following correlations would the psychologist hope to find in order to establish discriminant validity?
A)r = 1.0
B)r = −1.0
C)r = 0.83
D)r = −0.18
A)r = 1.0
B)r = −1.0
C)r = 0.83
D)r = −0.18
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
38
Your friend Dominic is complaining about having to take the Graduate Record Examination (GRE), a test that is required to go to graduate school and is similar to the ACT and SAT. He complains, "Tests like the GRE don't really measure how well people actually do in graduate school." Dominic is questioning the of the test.
A)discriminant validity
B)content validity
C)convergent validity
D)criterion validity
A)discriminant validity
B)content validity
C)convergent validity
D)criterion validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
39
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group of people in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. This procedure is known as a:
A)test-retest paradigm.
B)known-groups paradigm.
C)prediction paradigm.
D)group evaluation paradigm.
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group of people in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. This procedure is known as a:
A)test-retest paradigm.
B)known-groups paradigm.
C)prediction paradigm.
D)group evaluation paradigm.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
40
RESEARCH STUDY 5.2: Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Pathological gambling is defined as being unable to resist impulses to gamble. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. The measure has 15 questions, and it takes 20 minutes to complete.
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. Why did Dr. Sheffield do this?
A)To obtain evidence for face validity
B)To obtain evidence for content validity
C)To obtain evidence for convergent validity
D)To obtain evidence for criterion validity
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. Why did Dr. Sheffield do this?
A)To obtain evidence for face validity
B)To obtain evidence for content validity
C)To obtain evidence for convergent validity
D)To obtain evidence for criterion validity
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
41
If a measurement looks like it is a plausible operationalization of a conceptual variable, then it has:
A)interrater reliability.
B)subjectivity.
C)face validity.
D)credibility.
A)interrater reliability.
B)subjectivity.
C)face validity.
D)credibility.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
42
Explain why many people feel that physiological measurements are the best way to operationalize a variable but why they may not, in fact, be the best.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
43
Dr. Sarolli is planning on measuring literacy (defined as the ability to read and write written text in one's native language). He decides he wants to create a quantitative operational definition. Create an ordinal, interval, and ratio way to measure literacy.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
44
Explain why the textbook argues, "In fact, operationalizations are one place where creativity comes into the research process."
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
45
In order to use the known groups paradigm to establish criterion validity, which of the following is necessary?
A)At least three groups must be used.
B)After testing, the groups should have significantly different scores on the measure.
C)Prior to testing, similarity between the groups must be demonstrated.
D)The groups must be composed of experts in the field of psychology.
A)At least three groups must be used.
B)After testing, the groups should have significantly different scores on the measure.
C)Prior to testing, similarity between the groups must be demonstrated.
D)The groups must be composed of experts in the field of psychology.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
46
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Name two types of reliability that apply to Dr. Li's measure and how each one could be established, given the above scenario.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Name two types of reliability that apply to Dr. Li's measure and how each one could be established, given the above scenario.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
47
RESEARCH STUDY 5.3: Lauren, Sarah, and Jennifer are students in Dr. Shaffer's Research Methods class. For a class assignment, they are asked to devise an operational definition for romantic attachment, or love. Lauren decides to ask a group of married couples to report if they are in love with their spouse (1 indicates "Yes, I am in love" and 2 indicates "No, I am not in love"). Sarah decides to watch couples sitting on campus and measure how close they sit together, assuming that people who sit closer together are more in love. Jennifer decides to recruit a group of newlyweds and measure the change in heart rate that occurs between the start of the study (when the person is alone) and the moment they see their spouse walk into the room.
For each student described above, indicate whether the operational definition of her variable is self-reported, observational, or physiological.
For each student described above, indicate whether the operational definition of her variable is self-reported, observational, or physiological.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
48
A helpful tool for visualizing test-retest reliability and interrater reliability is a:
A)bar graph.
B)Cronbach's alpha.
C)correlation coefficient.
D)scatterplot.
A)bar graph.
B)Cronbach's alpha.
C)correlation coefficient.
D)scatterplot.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
49
Imagine that you are trying to measure people's stress. Provide an example of measuring stress using a self-report measure, a physiological measure, and a behavioral measure.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
50
Explain the difference between validity and reliability. Explain whether they are related or independent concepts.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
51
Name the three types of internal reliability and the four types of validity.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
52
When using correlation coefficients to evaluate reliability, which of the following is undesirable?
A)A correlation coefficient close to 1
B)A negative correlation coefficient
C)A strong correlation coefficient
D)It depends on the type of reliability being evaluated.
A)A correlation coefficient close to 1
B)A negative correlation coefficient
C)A strong correlation coefficient
D)It depends on the type of reliability being evaluated.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
53
Two researchers tell you they study the same thing. However, when you look at their research papers, they do not use similar methodologies or measurements. How is this possible?
A)The researchers have the same conceptual definitions.
B)The researchers have the same operational definitions.
C)The researchers have the same conceptual definitions and operational definitions.
D)The researchers do not have the same conceptual definitions nor the same operational definitions.
A)The researchers have the same conceptual definitions.
B)The researchers have the same operational definitions.
C)The researchers have the same conceptual definitions and operational definitions.
D)The researchers do not have the same conceptual definitions nor the same operational definitions.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
54
Asking an expert or experts to evaluate a measure is used to establish validity.
A)content
B)criterion
C)divergent
D)face
A)content
B)criterion
C)divergent
D)face
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
55
What is the term for a researcher's definition of the variable in question at a theoretical level?
A)Measurement validity
B)Construct validity
C)Conceptual definition
D)Operational definition
A)Measurement validity
B)Construct validity
C)Conceptual definition
D)Operational definition
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
56
In looking at a scatterplot of interrater reliability, why would a researcher want to see all the dots close to the line of agreement?
A)Because it indicates a positive relationship
B)Because it indicates that the researcher's two research assistants/raters are making similar measurements
C)Because it indicates that the researcher's measurement is valid
D)Because it indicates that the researcher's measurement will also have high test-retest reliability
A)Because it indicates a positive relationship
B)Because it indicates that the researcher's two research assistants/raters are making similar measurements
C)Because it indicates that the researcher's measurement is valid
D)Because it indicates that the researcher's measurement will also have high test-retest reliability
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
57
Imagine that you are trying to measure people's stress. Provide three quantitative definitions of stress: one that is ordinal, one that is interval, and one that is ratio.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
58
RESEARCH STUDY 5.3: Lauren, Sarah, and Jennifer are students in Dr. Shaffer's Research Methods class. For a class assignment, they are asked to devise an operational definition for romantic attachment, or love. Lauren decides to ask a group of married couples to report if they are in love with their spouse (1 indicates "Yes, I am in love" and 2 indicates "No, I am not in love"). Sarah decides to watch couples sitting on campus and measure how close they sit together, assuming that people who sit closer together are more in love. Jennifer decides to recruit a group of newlyweds and measure the change in heart rate that occurs between the start of the study (when the person is alone) and the moment they see their spouse walk into the room.
For each student described above, indicate whether the operational definition of her variable is categorical or quantitative. If a student's operational variable is categorical, explain whether it could or could not be made quantitative and how you would do that.
For each student described above, indicate whether the operational definition of her variable is categorical or quantitative. If a student's operational variable is categorical, explain whether it could or could not be made quantitative and how you would do that.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
59
A correlation coefficient and a scatterplot both provide which of the following pieces of information?
A)The strength and direction of the relationship between two measurements
B)The path and significance of the relationship between two measurements
C)The validity and reliability of two measurements
D)The outliers present in the two measurements
A)The strength and direction of the relationship between two measurements
B)The path and significance of the relationship between two measurements
C)The validity and reliability of two measurements
D)The outliers present in the two measurements
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
60
Your friend Alanna says that when examining validity, you always want to see positive correlations. Why is she wrong?
A)Both the strength and the direction of a correlation matter when examining validity.
B)The strength of a correlation matters, but the direction of a correlation does not matter.
C)Negative correlations are desirable when examining validity.
D)Correlations are not used to examine validity.
A)Both the strength and the direction of a correlation matter when examining validity.
B)The strength of a correlation matters, but the direction of a correlation does not matter.
C)Negative correlations are desirable when examining validity.
D)Correlations are not used to examine validity.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
61
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Given the situation above, explain the difference between criterion validity, convergent validity, and discriminant validity. Why is each one important?
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Given the situation above, explain the difference between criterion validity, convergent validity, and discriminant validity. Why is each one important?
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
62
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Dr. Li gives his new measure to a group of 100 adults in order to test the internal validity of his measure. Draw two scatterplots: one that demonstrates the likely relationship between Statements 1 and 2 and one that demonstrates the likely relationship between Statements 1 and 3. Explain why you have drawn each scatterplot as you have.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Dr. Li gives his new measure to a group of 100 adults in order to test the internal validity of his measure. Draw two scatterplots: one that demonstrates the likely relationship between Statements 1 and 2 and one that demonstrates the likely relationship between Statements 1 and 3. Explain why you have drawn each scatterplot as you have.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
63
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Provide a suggestion for how Dr. Li could establish the criterion validity of his measure.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Provide a suggestion for how Dr. Li could establish the criterion validity of his measure.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
64
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Dr. Li gives his new measure to a group of 100 adults in order to test the internal validity of his measure. What type of correlation coefficients (r) would Dr. Li expect to find between Statements 1 and 2 and between Statements 1 and 3? What would these correlation coefficients tell Dr. Li about the internal reliability of his measure?
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Dr. Li gives his new measure to a group of 100 adults in order to test the internal validity of his measure. What type of correlation coefficients (r) would Dr. Li expect to find between Statements 1 and 2 and between Statements 1 and 3? What would these correlation coefficients tell Dr. Li about the internal reliability of his measure?
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck
65
RESEARCH STUDY 5.4: Dr. Li is interested in creating a measurement of religiosity. According to the dictionary, religiosity is "the quality of being religious; piety; devoutness." He creates a measure comprising 10 statements. People respond to each statement using the following scale (1 = strongly disagree, 3 = neither agree nor disagree, 5 = strongly agree). Some of the statements are below.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Provide a suggestion for how Dr. Li could establish the face validity of his measure and a suggestion for how he could establish the content validity of his measure.
Statement 1: "I believe in a religion."
Statement 2: "Part of who I am stems from my religious beliefs."
Statement 3: "I believe that religion is unnecessary."
Provide a suggestion for how Dr. Li could establish the face validity of his measure and a suggestion for how he could establish the content validity of his measure.
Unlock Deck
Unlock for access to all 65 flashcards in this deck.
Unlock Deck
k this deck