Deck 10: Comparing More Than Two Means

Question 1

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.

-What are the observational units?

A) Months
B) Toys
C) Test conditions
D) Rats

Answer 1

Rats

Question 2

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.

-Which of the following plots would be appropriate to investigate the relationship between test condition and number of attempts needed to learn to navigate a maze? Select all that apply.

A) Scatterplot
B) Segmented bar graph
C) Side-by-side boxplots
D) Stacked dot plots

Answer 2

Side-by-side boxplots
Stacked dot plots

Question 3

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.
-What is the value of the Mean Group Diff statistic?

Answer 3

5.967

Question 4

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.

-A simulated null distribution of 1,000 Mean Group Diff statistics follows. Describe how to use this distribution to calculate the p-value.

A) Count the proportion of samples less than or equal to 5.967.
B) Count the proportion of samples greater than or equal to 5.967.
C) Count the proportion of samples greater than or equal to 14.45.
D) Count the proportion of samples less than or equal to -5.967 and greater than or equal to 5.967.

Question 5

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.

-Does the analysis using the Mean Group Diff statistic allow you to determine which test conditions differ significantly from which others?

A) Yes, since the Mean Group Diff statistic was statistically significant.
B) Yes, since the sample means across groups differ.
C) No, since it is an overall test.
D) No, since the sample size is too small.

Question 6

In a neurological study of the effect of environment on mental development, rats were randomly assigned to be raised in one of the four following test conditions: Impoverished (wire mesh cage - housed alone), Standard (cage with other rats), Enriched (cage with other rats and toys), and Super Enriched (cage with other rats and toys changed on a periodic basis). After two months, the rats were tested on a variety of learning measures, one of them being the number of attempts needed to learn to navigate a maze. The data for the maze task are below, along with means and standard deviation for each group.

-Suppose that, in reality, there is no association between test condition and number of attempts needed to learn to navigate a maze. Which of the following sets of tests would have the largest probability of at least one Type I error?

A) and
B) and
C)
D)
E) and and

Question 7

As the Mean Group Diff statistic increases, the p-value also increases.

Question 8

A simulated null distribution of the Mean Group Diff statistic will always be symmetric.

Question 9

The Mean Group Diff statistic cannot be negative.

Question 10

The two graphs, A and B, show dotplots from two different data sets. Suppose I want to com-pare the means in A and do another comparison of means in B. For each case I compute a MAD statistic. Which of the following will be true about these statistics?

A) The MAD statistic is the same in A and B.
B) The MAD statistic is larger in A than in B.
C) The MAD statistic is smaller in A than in B.
D) We cannot tell if the MAD statistic will be larger in A or B.

Question 11

College students tested to see if how well you know a person affects your ability to detect a lie from that person. To do this, they came up with 10 statements about a person in their group. Five of these statements were true and five were False. The group tried to make up statements that no-body (not even close friends) would know if they were true or False. The students then presented these statements to people that fit in three groups: close friends, acquaintances, and complete strangers and counted how many statements each person correctly identified as true or False. A summary of the results are as follows.
-Compute the Mean Group Diff statistic for this data set.

Question 12

College students tested to see if how well you know a person affects your ability to detect a lie from that person. To do this, they came up with 10 statements about a person in their group. Five of these statements were true and five were False. The group tried to make up statements that no-body (not even close friends) would know if they were true or False. The students then presented these statements to people that fit in three groups: close friends, acquaintances, and complete strangers and counted how many statements each person correctly identified as true or False. A summary of the results are as follows.

-A null distribution was generated for this example and is shown. What is the shape of this distribution?

A) Normal
B) Symmetric
C) Left skewed
D) Right skewed

Question 13

College students tested to see if how well you know a person affects your ability to detect a lie from that person. To do this, they came up with 10 statements about a person in their group. Five of these statements were true and five were False. The group tried to make up statements that no-body (not even close friends) would know if they were true or False. The students then presented these statements to people that fit in three groups: close friends, acquaintances, and complete strangers and counted how many statements each person correctly identified as true or False. A summary of the results are as follows.

-Using the simulated null distribution of Mean Group Diff statistics in question 13, what is the strength of evidence against the null hypothesis?

A) Strong evidence against the null
B) Moderate evidence against the null
C) Weak evidence against the null
D) No evidence against the null

Question 14

College students tested to see if how well you know a person affects your ability to detect a lie from that person. To do this, they came up with 10 statements about a person in their group. Five of these statements were true and five were False. The group tried to make up statements that no-body (not even close friends) would know if they were true or False. The students then presented these statements to people that fit in three groups: close friends, acquaintances, and complete strangers and counted how many statements each person correctly identified as true or False. A summary of the results are as follows.

-If the Mean Group Diff statistic had been smaller than the observed Mean Group Diff statistic calculated in question 12, how would the strength of evidence change?

A) The strength of evidence against the null would increase.
B) The strength of evidence against the null would decrease.
C) The strength of evidence against the null would stay the same.

Question 15

College students tested to see if how well you know a person affects your ability to detect a lie from that person. To do this, they came up with 10 statements about a person in their group. Five of these statements were true and five were False. The group tried to make up statements that no-body (not even close friends) would know if they were true or False. The students then presented these statements to people that fit in three groups: close friends, acquaintances, and complete strangers and counted how many statements each person correctly identified as true or False. A summary of the results are as follows.

-The two graphs, A and B, show dotplots from two different data sets. Suppose I want to com-pare the means in A and do another comparison of means in B. For each case I compute an F-statistic. Which of the following will be true about these statistics?

A) The F-statistic is the same in A and B.
B) The F-statistic is larger in A than in B.
C) The F-statistic is smaller in A than in B.
D) We cannot tell if the F-statistic will be larger in A or B.

Question 16

When performing an ANOVA F-test, which definition of a p-value is the most accurate?

A) The p-value is the probability that the observed F-statistic will occur again.
B) If the null hypothesis is true, the p-value is the probability of observing an F-statistic as large or larger than the one actually observed.
C) The p-value is the value that an F-statistic must reach in order to be significant under the null hypothesis.
D) The p-value is the probability that the null hypothesis is true.

Question 17

Why do you do overall tests when comparing multiple means and not just do the follow-up confidence intervals?

A) Doing an overall test will more likely lead to significant results than just doing the follow-up confidence intervals.
B) Doing an overall test allows us to see exactly which group is significantly different from which other groups.
C) Doing an overall test allows us to quickly get our results, while the follow-up confidence intervals are very time-consuming.
D) Doing an overall test allows us to keep the probability of a type I error at 5% or whatever significance level we would like.

Question 18

As the F statistic increases, the p-value decreases.

Question 19

The F statistic can be negative.

Question 20

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-Follow-up 95% confidence intervals are presented below.
• • • The mean amount spent when pop music is playing is significantly lower than the mean amount spent when classical music is playing.

Question 21

As the size of the sample in each group increases, all else remaining the same, what will be the impact on the strength of evidence for finding a difference in the average scores on the three exams?

A) There will be more evidence of a difference.
B) There will be less evidence of a difference.
C) There will be no impact on the strength of evidence of a difference.
D) There is not enough information to tell.

Question 22

If changing the third treatment group from blue to purple increases the difference in the purple group's average score from the other two groups, all else remaining the same, what will be the impact on the strength of evidence for finding a difference in the average scores on the three exams?

A) There will be more evidence of a difference.
B) There will be less evidence of a difference.
C) There will be no an impact on the strength of evidence of a difference.
D) There is not enough information to tell.

Question 23

What is the null hypothesis? Select all that apply.

A) The long-run average amount spent on a meal while listening to music is the same for all three conditions - classical, pop, or none.
B) The sample average amount spent on a meal while listening to music is the same for all three conditions - classical, pop, or none.
C)
D)

Question 24

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-Which of the following validity conditions are met to conduct an ANOVA F-test on these data? Select all that apply.

A) The standard deviations of the sample are approximately equal.
B) The sample sizes are all at least 20.
C) The sample distributions show no strong skewness.
D) The sample means are all at least 20.

Question 25

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-Compute the F-statistic using the summary statistics listed.

Question 26

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-The p-value for the ANOVA F-test is less than 0.001. How would you interpret this value?

A) In less than 0.1% of all samples, the F-statistic would be as large or larger than the one observed, assuming there is no association between music type and amount spent on food and drinks.
B) In less than 0.1% of all samples, the F-statistic would be as small or smaller than the one observed, assuming there is no association between music type and amount spent on food and drinks.
C) In less than 0.1% of all samples, the F-statistic would be as large or larger than the one observed, assuming there is an association between music type and amount spent on food and drinks.
D) In less than 0.1% of all samples, the F-statistic would be as small or smaller than the one observed, assuming there is an association between music type and amount spent on food and drinks.

Question 27

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-Follow-up 95% confidence intervals are presented below.
• • • The mean amount spent when classical music is playing is significantly higher than the mean amount spent when no music is playing.

Question 28

A British study examined whether the type of background music playing in a restaurant affected the amount of money that diners spent on their meals. The researchers asked a restaurant to alternate silence, popular music, and classical music on successive nights over eighteen days. Each type of music was played for 6 nights (the order was randomly determined to guard against confounding). The type of music played and the amount spent on food and drinks (in British pounds) for each of 393 customers was recorded. The data are summarized below.



-Follow-up 95% confidence intervals are presented below.
• • • The mean amount spent when pop music is playing is significantly higher than the mean amount spent when no music is playing.