Question 1

Name two benefits of meta-analysis.

Accepted Answer

any two of the following are ok: 
1) detecting small or moderate relationships
2) obtaining a more precise estimate of a relationship
3) determining future research
4) finding patterns across studies.

Question 2

Which of the following is true about meta-analysis?

Accepted Answer

A) Meta-analysis has made it possible to find definitive answers to questions about small and moderate relationships by taking into account data from a number of different studies. 
B) Meta-analysis is a non-controversial approach to research. 
C) Meta-analysis just means "a very big analysis of one very big data set." 
D) All of the above statements are true. 
A) Meta-analysis has made it possible to find definitive answers to questions about small and moderate relationships by taking into account data from a number of different studies. 
B) Meta-analysis is a non-controversial approach to research. 
C) Meta-analysis just means "a very big analysis of one very big data set." 
D) All of the above statements are true. A

Question 3

Suppose you are doing a meta-analysis using 20 studies, and 2 of them show a much larger relationship between the variables studied, compared to all the others.Which of the following is an appropriate way to address this issue?

Accepted Answer

A) Throw those two studies out. 
B) Consider those two studies to be the most important and weight them accordingly in the meta-analysis. 
C) Conduct one meta-analysis that includes the two studies and another meta-analysis that excludes the two studies and compare the results. 
D) None of the above. 
A) Throw those two studies out. 
B) Consider those two studies to be the most important and weight them accordingly in the meta-analysis. 
C) Conduct one meta-analysis that includes the two studies and another meta-analysis that excludes the two studies and compare the results. 
D) None of the above. C

Question 4

One problem of meta-analysis is that two different studies may involve subtle differences in treatments but call the treatments by the same name.Give an example.

Accepted Answer

any reasonable answer ok.Examp

Question 5

Meta-analysis can miss detecting results that are actually statistically significant due to __________ samples and/or possible methodological __________.

Accepted Answer

Answers (r

Question 6

If the original studies were flawed or biased, what is true about the resulting meta-analysis?

Accepted Answer

A) It will also be flawed or biased. 
B) It will be able to minimize or even eliminate the flaws and bias. 
C) It will be unaffected. 
D) The impact is unknown - the flaws or biases may enter into the meta-analysis or may not. 
A) It will also be flawed or biased. 
B) It will be able to minimize or even eliminate the flaws and bias. 
C) It will be unaffected. 
D) The impact is unknown - the flaws or biases may enter into the meta-analysis or may not.

Question 7

Name three possible problems with meta-analysis.

Accepted Answer

any three of the following are ok: 
1) s

Question 8

Give two criteria that researchers often use to decide whether or not a certain study should be included in a meta-analysis.

Accepted Answer

any two reasonable answers ok.

Question 9

Can a meta-analysis erroneously reach the conclusion that there is no difference or relationship?

Accepted Answer

A) Yes, when there are small sample sizes and/or possible methodological flaws. 
B) Yes, because of its typically extra-large sample size. 
C) No, a meta-analysis can never erroneously reach a conclusion of no relationship because a meta-analysis is so comprehensive. 
D) No.If there is no relationship, then there is no erroneous conclusion to come to in the first place. 
A) Yes, when there are small sample sizes and/or possible methodological flaws. 
B) Yes, because of its typically extra-large sample size. 
C) No, a meta-analysis can never erroneously reach a conclusion of no relationship because a meta-analysis is so comprehensive. 
D) No.If there is no relationship, then there is no erroneous conclusion to come to in the first place.

Question 10

Meta-analysis is particularly likely to find results that __________ (choose: are, are not) statistically significant.

Accepted Answer

The answer of Meta-analysis is particularly likely to find results...

Question 11

What is meant by the 'file drawer problem' regarding meta-analysis?

Accepted Answer

numerous studies may not have

Question 12

Which of the following cautions must be applied with a meta-analysis?

Accepted Answer

A) Beware of confounding variables. 
B) Be careful about concluding causal relationships. 
C) More isn't necessarily better; a single analysis from a well-conducted study is better than a meta-analysis from several poor studies. 
D) All of the above. 
A) Beware of confounding variables. 
B) Be careful about concluding causal relationships. 
C) More isn't necessarily better; a single analysis from a well-conducted study is better than a meta-analysis from several poor studies. 
D) All of the above.

Question 13

A meta-analysis combines data from separate studies, and hence can be prone to the statistical phenomenon known as _______________.

Accepted Answer

The answer of A meta-analysis combines data from separate studies,...

Question 14

If the statistically significant studies of a relationship are the ones that are more likely to be available, what effect will this have on the resulting meta-analysis?

Accepted Answer

It may ove

Question 15

Why do we characterize a meta-analysis as being an observational study (versus an experiment)?

Accepted Answer

the various treatments cannot

Question 16

When reading the results of a meta-analysis, what two important things do you need to know?

Accepted Answer

1) which studies wer

Question 17

Reports are often published that appear to conflict with earlier results, confusing the public and researchers alike.How can a meta-analysis help address this problem?

Accepted Answer

A meta-analysis uses a collect

Question 18

Name one way in which a meta-analysis improves the situation where many small studies were conducted, but no large studies.

Accepted Answer

either of the following: 
1) allows rese

Question 19

Reports are often published that appear to conflict with earlier results, confusing the public and researchers alike.How can sample size play a role in this?

Accepted Answer

smaller samples are less likel

Question 20

Which of the following statements comparing the vote-count approach and the meta-analysis approach is false?

Accepted Answer

A) A meta-analysis focuses on the magnitude of the effect in each study, and vote-count does not. 
B) Vote-count only works for studies involving categorical variables, while a meta-analysis can be used on any type of study. 
C) A vote-count approach typically weights each study the same, regardless of sample size, while a meta-analysis typically does not. 
D) None of the above. 
A) A meta-analysis focuses on the magnitude of the effect in each study, and vote-count does not. 
B) Vote-count only works for studies involving categorical variables, while a meta-analysis can be used on any type of study. 
C) A vote-count approach typically weights each study the same, regardless of sample size, while a meta-analysis typically does not. 
D) None of the above.

Exam 25: Meta-Analysis: Resolving Inconsistencies Across Studies

Name two benefits of meta-analysis.

Which of the following is true about meta-analysis?

Suppose you are doing a meta-analysis using 20 studies, and 2 of them show a much larger relationship between the variables studied, compared to all the others.Which of the following is an appropriate way to address this issue?

One problem of meta-analysis is that two different studies may involve subtle differences in treatments but call the treatments by the same name.Give an example.

Meta-analysis can miss detecting results that are actually statistically significant due to __________ samples and/or possible methodological __________.

If the original studies were flawed or biased, what is true about the resulting meta-analysis?

Name three possible problems with meta-analysis.

Give two criteria that researchers often use to decide whether or not a certain study should be included in a meta-analysis.

Can a meta-analysis erroneously reach the conclusion that there is no difference or relationship?

Meta-analysis is particularly likely to find results that __________ (choose: are, are not) statistically significant.

What is meant by the 'file drawer problem' regarding meta-analysis?

Which of the following cautions must be applied with a meta-analysis?

A meta-analysis combines data from separate studies, and hence can be prone to the statistical phenomenon known as _______________.

If the statistically significant studies of a relationship are the ones that are more likely to be available, what effect will this have on the resulting meta-analysis?

Why do we characterize a meta-analysis as being an observational study (versus an experiment)?

When reading the results of a meta-analysis, what two important things do you need to know?

Reports are often published that appear to conflict with earlier results, confusing the public and researchers alike.How can a meta-analysis help address this problem?

Name one way in which a meta-analysis improves the situation where many small studies were conducted, but no large studies.

Reports are often published that appear to conflict with earlier results, confusing the public and researchers alike.How can sample size play a role in this?

Which of the following statements comparing the vote-count approach and the meta-analysis approach is false?

The Benefits and Risks of Using Statistics

Reading the News

Measurements, Mistakes, and Misunderstandings

How to Get a Good Sample

Experiments and Observational Studies

Getting the Big Picture

Summarizing and Displaying Measurement Data

Bell-Shaped Curves and Other Shapes

Plots, Graphs, and Pictures

Relationships Between Measurement Variables

Relationships Can Be Deceiving

Relationships Between Categorical Variables

Statistical Significance for 2 2 Tables

Understanding Probability and Long-Term Expectations

Understanding Uncertainty Through Simulation

Psychological Influences on Personal Probability

When Intuition Differs From Relative Frequency

Understanding the Economic News

The Diversity of Samples From the Same Population

Estimating Proportions With Confidence

The Role of Confidence Intervals in Research

Rejecting Chancetesting Hypotheses in Research

Hypothesis Testingexamples and Case Studies

Significance, Importance, and Undetected Differences

Ethics in Statistical Studies

Putting What You Have Learned to the Test

Filters

Meta-analysis can miss detecting results that are actually statistically significant due to samples and/or possible methodological .