Question 1

The major issue underlying external validity is that of

Accepted Answer

A)   ecological validity.
B)   generalization.
C)   random assignment.
D)   meta analysis. B

Question 2

Which of the following is NOT true about meta-analyses?

Accepted Answer

A)   They use the effect size statistic to indicate the size of relationships.
B)   They are explicit about which studies are or are not included in the analysis.
C)   They are used to draw conclusions about research literatures.
D)   They are less objective than narrative literature reviews. D

Question 3

If a researcher conducted a meta-analysis on the effects of performance enhancing drugs within professional sports, she would be most likely to

Accepted Answer

A)   interview a representative sample of current professional sports teams.
B)   compare her data to data from earlier findings on this topic.
C)   discuss the manipulation of the independent variables at an upcoming psychological conference.
D)   analyze the data on this topic from many prior studies. D

Question 4

The primary goal of replication is to

Accepted Answer

A)   examine new conditions of an old experiment.
B)   test a different research hypothesis than was previously tested.
C)   investigate if the procedures in a previous study were detailed enough to be followed exactly.
D)   determine the extent to which an observed relationship generalizes across different tests of the research hypothesis.

Question 5

Findings that do not generalize

Accepted Answer

A)   should always be ignored.
B)   are likely caused by confounding.
C)   are still useful because they may provide information about the limitations of prior studies.
D)   nevertheless have high internal validity.

Question 6

Which of the following is true?

Accepted Answer

A)   It is useful to conduct exact replications because they provide information about generalization to new operationalizations of the original variables.
B)   It is useful to conduct constructive replications because they provide information about the exact circumstances in which an effect does or does not occur.
C)   It is useful to conduct constructive replications because they require fewer conditions than the original experiment.
D)   It is useful to conduct participant replications because their interpretation is usually very clear.

Question 7

Whereas internal validity refers to _________, external validity refers to _________.

Accepted Answer

A)   practical conclusions; statistical conclusions
B)   the relationship between the independent and the dependent variable; the extent to which the findings are expected to generalize
C)   the extent to which the findings are expected to generalize; the relationship between the independent and the dependent variable
D)   statistical conclusions; practical conclusions

Question 8

The idea of generalization is most closely related to

Accepted Answer

A)   external validity.
B)   internal validity.
C)   construct validity.
D)   statistical conclusion validity.

Question 9

A replication that investigates the relationship between the same conceptual variables that were studied in previous research but tests the hypothesis using different operational definitions of the independent variable and/or the dependent variable is known as a(n)

Accepted Answer

A)   conceptual replication.
B)   constructive replication.
C)   participant replication.
D)   exact replication.

Question 10

A document that discusses the research in a given area with the goals of summarizing existing findings, making inferences about the conditions under which relationships do and do not occur, linking research to findings in other areas, and suggesting further research is called a

Accepted Answer

A)   research program.
B)   review paper.
C)   program analysis.
D)   research report.

Question 11

Exact replications are most likely to be conducted because the researcher wants to

Accepted Answer

A)   add a new condition to a previous experiment.
B)   examine other possible conceptual variables involved in the results of a previous experiment.
C)   see if an effect that has been found in one laboratory or by one researcher can be found.
D)   repeat the original experiment with a different population of participants.

Question 12

Amalia conducted a study of how the media affects political affiliation. She showed participants a five-minute clip from CNN and then asked them to fill out a political ideology survey. Edward later conducted a similar study but had participants read an article from the Washington Post instead of watching a TV broadcast. Edward's study is an example of a

Accepted Answer

A)   participant replication.
B)   exact replication.
C)   constructive replication.
D)   conceptual replication.

Question 13

A limitation of meta-analyses is that

Accepted Answer

A)   they are less accurate than narrative reviews.
B)   because only significant studies are published, a relationship may be overestimated.
C)   psychological journals only date back to the late 1970s.
D)   effect sizes are not objective measures.

Question 14

A study involving the effect of physical activity on self-esteem has a p-value of .001 and has correctly ruled out all obvious alternative hypotheses. However, this study cannot be applied to any real-life settings. Thus it can be said to have __________.

Accepted Answer

A)   low internal validity, high external validity
B)   low internal validity, low external validity
C)   high internal validity, low external validity
D)   low construct validity, high convergent validity

Question 15

To determine whether a beneficial influence of therapy that has been found in a sample of women would also be found in a sample of men, the researcher will need to use which of the following?

Accepted Answer

A)   A participant replication
B)   A conceptual replication
C)   An exact replication
D)   A cross-cultural replication

Question 16

In comparison to lab experiments, field experiments have the advantage of

Accepted Answer

A)   increased ecological validity.
B)   increased internal validity.
C)   increased reactivity.
D)   increased statistical conclusion validity.

Question 17

Which of the following statistics serves as the dependent variable in a meta-analysis?

Accepted Answer

A)   The correlation coefficient
B)   The chi square
C)   The effect size
D)   The standard deviation

Question 18

Inclusion criteria refer to which of the following?

Accepted Answer

A)   Specific rules about which participants are to be used in an experiment
B)   Specific rules about which studies to include in a meta-analysis
C)   Specific conditions under which an experiment is likely to generalize
D)   Specific rules about choosing participants to complete an experiment

Question 19

Researchers in the behavioral sciences may be content to use college students as research participants because

Accepted Answer

A)   they can be assumed to have the same characteristics as any other sample of individuals.
B)   they represent a random sample of all human beings.
C)   they have had fewer experiences than many people, thus making them naive.
D)   they are more intelligent than most people.

Question 20

A variable that produces an interaction of the relationship between two other variables such that the relationship between them is different at different levels of that variable is a

Accepted Answer

A)   moderator variable.
B)   mediator variable.
C)   extraneous variable.
D)   confounding variable.

Exam 13: External Validity