Deck 7: C: Survey Design and Scale Construction: Is Going Greek a Great Idea

Question 1

Use the following to answer questions
Scenario III
Scenario III is based on fabricated data inspired by the following study:
U.S.Department of Labor,Bureau of Labor and Statistics (2014).American Time Use Survey Retrieved from http://www.bls.gov/tus/
American Time Use
The American Time Use Survey (ATUS)is a telephone survey developed by the Bureau of Labor and Statistics (BLS)to examine how U.S.citizens spend their time in a variety of domains,such as leisure activities,volunteer activities,and work.Data are collected via computer-assisted telephone interview.The ATUS has been administered annually since 2003.The major component of the ATUS is the 24-hour time use survey.Respondents are asked to indicate what activities they engaged in,and for how long,during a 24-hour period.The results of the survey are made public on the BLS website and are used widely by researchers in a variety of disciplines.Response rates vary,with survey data obtained from 28,729 individuals in 2003 (response rate 57.8 %),and 25,487 individuals in 2014 (response rate 51.0%).
(Scenario III)A psychologist used the 2014 ATUS data described in Scenario III to examine time spent working and time engaged in leisure activities.Based on your knowledge of survey research,which result is most appropriate for this study?

A) Individuals who work more spend significantly less time engaging in leisure activities.This suggests that working more causes one to have less time for leisure.
B) In an experiment examining the effect of work on leisure time,it was found that work negatively correlated with leisure time.This suggests that the more one works,the less one is able to engage in leisure activities.
C) There was a statistically significant negative relation between the amount of time one spends at work and the amount of time one spends on leisure activities.This suggests that the more one works,the less likely one is to have time for leisure.
D) There was a statistically significant positive relation between the amount of time one spends at work and the amount of time one spends on leisure activities.This suggests that the more one works,the less likely one is to have time for leisure.

Answer 1

There was a statistically significant negative relation between the amount of time one spends at work and the amount of time one spends on leisure activities.This suggests that the more one works,the less likely one is to have time for leisure.

Question 2

Use the following to answer questions
Scenario II
Scenario II is based on fabricated data inspired by the following study:
Phillips,S.R.& Silverman,S.(2012).Development of an instrument to assess fourth and fifth
grade students' attitudes toward physical education.Measurement in Physical Education and Exercise Science,16(4),316-327.
Physical Education Attitude
This study describes the development of a survey to assess the attitudes of children toward physical education (PE).The authors describe three phases in the survey development.In phase 1 they discuss item construction.The authors began by using an existing 20-item survey to assess attitudes toward PE.Responses to each item range from 1 = strongly disagree to 5 = strongly agree,with eight of the 20 items being negatively written.They then added eight items to this survey based on feedback from students with regard to their likes and dislikes about PE.In phase 2 the authors conducted a pilot study during which they administered the preliminary revised survey.For the pilot study the survey was administered to 493 children.The researchers then assessed the content validity of the survey items by having blinded reviewers categorize the items into six factors.This resulted in modifying the survey such that the final instrument contained 16 items.In phase 3 the authors describe the statistical analyses used to evaluate the 16-item survey's reliability and validity.The authors used Cronbach's alpha to determine the instrument's content validity.Values for each item ranged between .41 and .78.The authors conclude that the 16-item Student Attitude Toward Physical Education Survey is a valid and reliable assessment of children's attitudes toward PE.
(Scenario II)When developing the Student Attitude Toward Physical Education Survey the authors formatted items in a way to minimize the likelihood of participants providing a response set.This was done by:

A) keeping the response alternatives to each item consistent.
B) including reverse items in the final scale.
C) alternating between open-ended and close-ended questions.
D) creating all items with only forced-choice response options.

Answer 2

including reverse items in the final scale.

Question 3

Use the following to answer questions
Scenario II
Scenario II is based on fabricated data inspired by the following study:
Phillips,S.R.& Silverman,S.(2012).Development of an instrument to assess fourth and fifth
grade students' attitudes toward physical education.Measurement in Physical Education and Exercise Science,16(4),316-327.
Physical Education Attitude
This study describes the development of a survey to assess the attitudes of children toward physical education (PE).The authors describe three phases in the survey development.In phase 1 they discuss item construction.The authors began by using an existing 20-item survey to assess attitudes toward PE.Responses to each item range from 1 = strongly disagree to 5 = strongly agree,with eight of the 20 items being negatively written.They then added eight items to this survey based on feedback from students with regard to their likes and dislikes about PE.In phase 2 the authors conducted a pilot study during which they administered the preliminary revised survey.For the pilot study the survey was administered to 493 children.The researchers then assessed the content validity of the survey items by having blinded reviewers categorize the items into six factors.This resulted in modifying the survey such that the final instrument contained 16 items.In phase 3 the authors describe the statistical analyses used to evaluate the 16-item survey's reliability and validity.The authors used Cronbach's alpha to determine the instrument's content validity.Values for each item ranged between .41 and .78.The authors conclude that the 16-item Student Attitude Toward Physical Education Survey is a valid and reliable assessment of children's attitudes toward PE.
(Scenario II)What is a reason for why Phillips and Silverman conducted a pilot study in Scenario II?

A) They want to know if it will be a good tool to use.
B) They want to know if there are any confusing items.
C) They wanted to assess the reliability and validity of the survey.
D) All of the above.

Answer 3

All of the above.

Question 4

Use the following to answer questions
Scenario I
Scenario I is based on fabricated data inspired by the following study:
Coriddi,M. ,Angelos,T. ,Nadeau,M. ,Bennett,M.& Taylor,A.(2013).Analysis of satisfaction and well-being in the short follow-up from breast augmentation using the BREAST-Q,a validated survey instrument.Aesthetic Surgery Journal,33 (2),245-251.
Breast Augmentation Satisfaction
The authors of this study used the BREAST-Q survey to assess satisfaction following breast augmentation surgery.They administered the survey to 155 patients before and after they underwent breast augmentation surgery and found a significant increase in psychosocial well-being and sexual well-being.A significant positive relationship was also found between overall satisfaction and breast appearance (r = .80).Interestingly,there was a significant decrease in physical well-being following surgery.The results of the study suggest that breast augmentation has a positive effect on women.
(Scenario I)Suppose the participants surveyed in Scenario I were asked to respond to survey items using a 5-point scale in which 1 = very satisfied and 5 = very dissatisfied.While of the following does NOT describe this type of scale?

A) summated ratings scale
B) closed-ended scale
C) Likert scale
D) open-ended scale

Question 5

Use the following to answer questions
Scenario I
Scenario I is based on fabricated data inspired by the following study:
Coriddi,M. ,Angelos,T. ,Nadeau,M. ,Bennett,M.& Taylor,A.(2013).Analysis of satisfaction and well-being in the short follow-up from breast augmentation using the BREAST-Q,a validated survey instrument.Aesthetic Surgery Journal,33 (2),245-251.
Breast Augmentation Satisfaction
The authors of this study used the BREAST-Q survey to assess satisfaction following breast augmentation surgery.They administered the survey to 155 patients before and after they underwent breast augmentation surgery and found a significant increase in psychosocial well-being and sexual well-being.A significant positive relationship was also found between overall satisfaction and breast appearance (r = .80).Interestingly,there was a significant decrease in physical well-being following surgery.The results of the study suggest that breast augmentation has a positive effect on women.
(Scenario I)In Scenario I the authors state the relationship between overall satisfaction with breast augmentation surgery and satisfaction with breast appearance is r = .80.This means that:

A) the more satisfied women were with the appearance of their breasts,the more satisfied they were with their surgery experience.
B) there was a significant difference in overall satisfaction between women who reported satisfaction with their breast appearance and those who reported dissatisfaction with their breast appearance.
C) satisfaction with surgery experience is negatively related to satisfaction with breast appearance.
D) there is high internal-consistency validity between satisfaction with breast appearance and satisfaction with surgery experience.

Question 6

Use the following to answer questions
Scenario I
Scenario I is based on fabricated data inspired by the following study:
Coriddi,M. ,Angelos,T. ,Nadeau,M. ,Bennett,M.& Taylor,A.(2013).Analysis of satisfaction and well-being in the short follow-up from breast augmentation using the BREAST-Q,a validated survey instrument.Aesthetic Surgery Journal,33 (2),245-251.
Breast Augmentation Satisfaction
The authors of this study used the BREAST-Q survey to assess satisfaction following breast augmentation surgery.They administered the survey to 155 patients before and after they underwent breast augmentation surgery and found a significant increase in psychosocial well-being and sexual well-being.A significant positive relationship was also found between overall satisfaction and breast appearance (r = .80).Interestingly,there was a significant decrease in physical well-being following surgery.The results of the study suggest that breast augmentation has a positive effect on women.
(Scenario I)What is the best reason for why the authors probably selected the BREAST-Q to measure satisfaction associated with breast augmentation surgery?

A) satisfaction is not something easy to measure using observational methods
B) the researchers wanted to find a causal relationship between breast augmentation surgery and satisfaction
C) they were interested in obtaining information from just a few people
D) they wanted to assess satisfaction with breast augmentation surgery qualitatively

Question 7

Use the following to answer questions
Scenario II
Scenario II is based on fabricated data inspired by the following study:
Phillips,S.R.& Silverman,S.(2012).Development of an instrument to assess fourth and fifth
grade students' attitudes toward physical education.Measurement in Physical Education and Exercise Science,16(4),316-327.
Physical Education Attitude
This study describes the development of a survey to assess the attitudes of children toward physical education (PE).The authors describe three phases in the survey development.In phase 1 they discuss item construction.The authors began by using an existing 20-item survey to assess attitudes toward PE.Responses to each item range from 1 = strongly disagree to 5 = strongly agree,with eight of the 20 items being negatively written.They then added eight items to this survey based on feedback from students with regard to their likes and dislikes about PE.In phase 2 the authors conducted a pilot study during which they administered the preliminary revised survey.For the pilot study the survey was administered to 493 children.The researchers then assessed the content validity of the survey items by having blinded reviewers categorize the items into six factors.This resulted in modifying the survey such that the final instrument contained 16 items.In phase 3 the authors describe the statistical analyses used to evaluate the 16-item survey's reliability and validity.The authors used Cronbach's alpha to determine the instrument's content validity.Values for each item ranged between .41 and .78.The authors conclude that the 16-item Student Attitude Toward Physical Education Survey is a valid and reliable assessment of children's attitudes toward PE.
(Scenario II)After piloting the survey described in Scenario II,the authors found that many children responded by always using the endpoints in the provided set of response alternatives.The participants seem to be exhibiting which response bias?

A) the acquiescent response set
B) the error of central tendency
C) participant judgment bias
D) random response bias

Question 8

Use the following to answer questions
Scenario III
Scenario III is based on fabricated data inspired by the following study:
U.S.Department of Labor,Bureau of Labor and Statistics (2014).American Time Use Survey Retrieved from http://www.bls.gov/tus/
American Time Use
The American Time Use Survey (ATUS)is a telephone survey developed by the Bureau of Labor and Statistics (BLS)to examine how U.S.citizens spend their time in a variety of domains,such as leisure activities,volunteer activities,and work.Data are collected via computer-assisted telephone interview.The ATUS has been administered annually since 2003.The major component of the ATUS is the 24-hour time use survey.Respondents are asked to indicate what activities they engaged in,and for how long,during a 24-hour period.The results of the survey are made public on the BLS website and are used widely by researchers in a variety of disciplines.Response rates vary,with survey data obtained from 28,729 individuals in 2003 (response rate 57.8 %),and 25,487 individuals in 2014 (response rate 51.0%).
(Scenario III)Based on the information provided in Scenario III,which statement are you more likely to agree with?

A) For survey research to be credible,a response rate closer to 100% is required.
B) This response rate is common and acceptable for survey research.
C) The BLS probably didn't provide enough of an incentive for participation.
D) More responses would have been obtained had the BLS conducted face-to-face interviews.

Question 9

Use the following to answer questions
Scenario III
Scenario III is based on fabricated data inspired by the following study:
U.S.Department of Labor,Bureau of Labor and Statistics (2014).American Time Use Survey Retrieved from http://www.bls.gov/tus/
American Time Use
The American Time Use Survey (ATUS)is a telephone survey developed by the Bureau of Labor and Statistics (BLS)to examine how U.S.citizens spend their time in a variety of domains,such as leisure activities,volunteer activities,and work.Data are collected via computer-assisted telephone interview.The ATUS has been administered annually since 2003.The major component of the ATUS is the 24-hour time use survey.Respondents are asked to indicate what activities they engaged in,and for how long,during a 24-hour period.The results of the survey are made public on the BLS website and are used widely by researchers in a variety of disciplines.Response rates vary,with survey data obtained from 28,729 individuals in 2003 (response rate 57.8 %),and 25,487 individuals in 2014 (response rate 51.0%).
(Scenario III)Suppose a group of researchers found a strong positive correlation between the 2013 and 2014 results of the ATUS.This information would support the _____ reliability of the ATUS.

A) alternative-form
B) internal consistency
C) test-retest
D) construct

Question 10

Use the following to answer questions
Scenario II
Scenario II is based on fabricated data inspired by the following study:
Phillips,S.R.& Silverman,S.(2012).Development of an instrument to assess fourth and fifth
grade students' attitudes toward physical education.Measurement in Physical Education and Exercise Science,16(4),316-327.
Physical Education Attitude
This study describes the development of a survey to assess the attitudes of children toward physical education (PE).The authors describe three phases in the survey development.In phase 1 they discuss item construction.The authors began by using an existing 20-item survey to assess attitudes toward PE.Responses to each item range from 1 = strongly disagree to 5 = strongly agree,with eight of the 20 items being negatively written.They then added eight items to this survey based on feedback from students with regard to their likes and dislikes about PE.In phase 2 the authors conducted a pilot study during which they administered the preliminary revised survey.For the pilot study the survey was administered to 493 children.The researchers then assessed the content validity of the survey items by having blinded reviewers categorize the items into six factors.This resulted in modifying the survey such that the final instrument contained 16 items.In phase 3 the authors describe the statistical analyses used to evaluate the 16-item survey's reliability and validity.The authors used Cronbach's alpha to determine the instrument's content validity.Values for each item ranged between .41 and .78.The authors conclude that the 16-item Student Attitude Toward Physical Education Survey is a valid and reliable assessment of children's attitudes toward PE.
(Scenario II)One of the items included in the scale administered during the pilot study described in Scenario II was "After PE I feel physically tired and mentally tired." This item was later changed,most likely because:

A) it was double-barreled.
B) "physically tired" and "mentally tired" are jargon phrases.
C) the reading level is too high for a fourth- and fifth-grade sample.
D) All of the above.

Question 11

Use the following to answer questions
Scenario III
Scenario III is based on fabricated data inspired by the following study:
U.S.Department of Labor,Bureau of Labor and Statistics (2014).American Time Use Survey Retrieved from http://www.bls.gov/tus/
American Time Use
The American Time Use Survey (ATUS)is a telephone survey developed by the Bureau of Labor and Statistics (BLS)to examine how U.S.citizens spend their time in a variety of domains,such as leisure activities,volunteer activities,and work.Data are collected via computer-assisted telephone interview.The ATUS has been administered annually since 2003.The major component of the ATUS is the 24-hour time use survey.Respondents are asked to indicate what activities they engaged in,and for how long,during a 24-hour period.The results of the survey are made public on the BLS website and are used widely by researchers in a variety of disciplines.Response rates vary,with survey data obtained from 28,729 individuals in 2003 (response rate 57.8 %),and 25,487 individuals in 2014 (response rate 51.0%).
(Scenario III)Suppose a psychologist used the ATUS to test whether volunteerism is related to education level.The psychologist predicted that those with more education would report spending more time volunteering.The psychologist made a _____ hypothesis.

A) predictive
B) correlational
C) directional
D) nondirectional

Question 12

Use the following to answer questions
Scenario II
Scenario II is based on fabricated data inspired by the following study:
Phillips,S.R.& Silverman,S.(2012).Development of an instrument to assess fourth and fifth
grade students' attitudes toward physical education.Measurement in Physical Education and Exercise Science,16(4),316-327.
Physical Education Attitude
This study describes the development of a survey to assess the attitudes of children toward physical education (PE).The authors describe three phases in the survey development.In phase 1 they discuss item construction.The authors began by using an existing 20-item survey to assess attitudes toward PE.Responses to each item range from 1 = strongly disagree to 5 = strongly agree,with eight of the 20 items being negatively written.They then added eight items to this survey based on feedback from students with regard to their likes and dislikes about PE.In phase 2 the authors conducted a pilot study during which they administered the preliminary revised survey.For the pilot study the survey was administered to 493 children.The researchers then assessed the content validity of the survey items by having blinded reviewers categorize the items into six factors.This resulted in modifying the survey such that the final instrument contained 16 items.In phase 3 the authors describe the statistical analyses used to evaluate the 16-item survey's reliability and validity.The authors used Cronbach's alpha to determine the instrument's content validity.Values for each item ranged between .41 and .78.The authors conclude that the 16-item Student Attitude Toward Physical Education Survey is a valid and reliable assessment of children's attitudes toward PE.
(Scenario II)Suppose the authors of the Student Attitude Toward Physical Education Survey stated it had strong convergent validity.The evidence to support this statement would likely include data showing:

A) their survey included a wide range of elements related to physical education.
B) a positive correlation between kids' attitudes on this instrument and kids' attitudes on a similar instrument.
C) the survey does not correspond to measures of other unrelated variables.
D) All of the above.

Question 13

Use the following to answer questions
Scenario I
Scenario I is based on fabricated data inspired by the following study:
Coriddi,M. ,Angelos,T. ,Nadeau,M. ,Bennett,M.& Taylor,A.(2013).Analysis of satisfaction and well-being in the short follow-up from breast augmentation using the BREAST-Q,a validated survey instrument.Aesthetic Surgery Journal,33 (2),245-251.
Breast Augmentation Satisfaction
The authors of this study used the BREAST-Q survey to assess satisfaction following breast augmentation surgery.They administered the survey to 155 patients before and after they underwent breast augmentation surgery and found a significant increase in psychosocial well-being and sexual well-being.A significant positive relationship was also found between overall satisfaction and breast appearance (r = .80).Interestingly,there was a significant decrease in physical well-being following surgery.The results of the study suggest that breast augmentation has a positive effect on women.
(Scenario I)In Scenario II,the statistic used to measure the relationship between overall satisfaction and breast appearance is the:

A) t-test.
B) ANOVA.
C) chi square.
D) correlation.