Deck 12: Experimental Control and Internal Validity

Question 1

Which of the following is NOT a method by which experimenters control for extraneous variables?

A) Limited population designs
B) Random assignment to conditions
C) Matched group designs
D) Before after designs

Answer 1

B

Question 2

The absence of confounding variables assures

A) external validity.
B) experimental realism.
C) internal validity.
D) alternative explanations.

Answer 2

C

Question 3

The possibility that a confounding variable, rather than the independent variable of interest, caused changes on the dependent measure represents

A) an alternative explanation.
B) an artifact.
C) a placebo effect.
D) a demand characteristic.

Answer 3

A

Question 4

A researcher who uses only college students in her research may be trying to

A) increase experimental control.
B) reduce confounding.
C) increase external validity.
D) prevent a Type 1 error.

Question 5

Extraneous variables

A) reduce power and increase the likelihood of a Type 2 error.
B) increase power and reduce the likelihood of a Type 2 error.
C) reduce power and reduce the likelihood of a Type 2 error.
D) increase power and increase the likelihood of a Type 2 error.

Question 6

A confounding variable is an example of ___________, whereas an extraneous variable is an example of __________.

A) systematic error; experimenter error
B) random error; systematic error
C) experimenter error; random error
D) systematic error; random error

Question 7

When participants are measured on the variable of interest before the experiment begins and are then assigned to conditions on the basis of their score, the design is called a

A) one way design.
B) two way design.
C) matched group design.
D) before after design.

Question 8

The extent to which changes in the dependent variable can confidently be attributed to the influence of the independent variable is known as

A) pilot testing.
B) experimental impact.
C) internal validity.
D) internal analysis.

Question 9

A baseline measure is

A) an initial measurement of the dependent variable in a before after research design.
B) a measure that is given in case a before after research design is spurious.
C) a measure that is accompanied by a cover story.
D) used to increase external validity.

Question 10

Which of the following is an advantage of before-after designs?

A) Participants experience less fatigue.
B) Participants are less likely to guess the research hypothesis.
C) Random error is reduced.
D) Statistical power is decreased.

Question 11

The goal of treating all experimental participants in exactly the same way with the simple exception of the manipulation itself is known as

A) statistical conclusion validity.
B) standardization of conditions.
C) construct validity.
D) internal validity.

Question 12

A researcher found that conclusions regarding his research were incorrect because a Type 1 error had been made. His error represents a type of

A) internal invalidity.
B) criterion invalidity.
C) statistical conclusion invalidity.
D) external invalidity.

Question 13

Which of the following types of validity refers to the extent to which the measured variables actually measure the conceptual variables?

A) Statistical conclusion validity
B) Internal validity
C) Construct validity
D) External validity

Question 14

Experimental control refers to which of the following?

A) The use of random assignment to conditions
B) The conduct of research in a laboratory
C) The manipulation of the independent variable
D) The extent to which unwanted influences on the dependent variable have been eliminated.

Question 15

Which of the following procedures can be used to help ensure standardization of conditions?

A) Automated experiments and the experimental script
B) Manipulation checks and confound checks
C) Experimental realism and mundane realism
D) Internal validation and external validation

Question 16

The possibility of making a Type 2 error in an experiment would most likely be reduced by using which of the following procedures?

A) Drawing a more representative sample
B) Using a manipulation check
C) Manipulating the independent variable
D) Standardizing conditions

Question 17

Incorrect conclusions about research that occur because a Type 1 or Type 2 error has been made lead to which of the following?

A) External invalidity
B) Statistical conclusion invalidity
C) Confounding
D) Internal invalidity

Question 18

In scientific research, validity refers to

A) whether the research has been carefully conducted.
B) whether the conclusions drawn about the research are correct.
C) whether an experimental design has been used.
D) whether the scientist has used a representative sample.

Question 19

Which of the following is a possible disadvantage of before after research designs?

A) High statistical power
B) Statistical conclusion invalidity
C) Retesting effects
D) High random error

Question 20

A variable other than the independent variable that is found to vary systematically among the conditions is known as

A) an extraneous variable.
B) a confounding variable.
C) a baseline variable.
D) a manipulation variable.

Question 21

Which of the following is true of an internal analysis?

A) The manipulation check is correlated with the dependent measure.
B) The confound check is correlated with the dependent measure.
C) The manipulation check is correlated with the independent variable.
D) The confound check is correlated with the independent variable.

Question 22

Aspects of the research that allow the participants to guess the research hypothesis are known as

A) content validity.
B) pilot tests.
C) demand characteristics.
D) confound checks.

Question 23

An experimenter wishes to know if his research procedure is going to work as he hoped it would. What procedure might he use?

A) Experimental scripting
B) Manipulation checking
C) Pilot testing
D) Confound testing

Question 24

A technique in which participants are told that they will be participating in two separate experiments, but in reality the experimental manipulation is presented in the first experiment and the dependent measure is collected in the second experiment, is called the

A) two-experiments technique.
B) cover story technique.
C) placebo technique.
D) unrelated-experiments technique.

Question 25

Which of the following best describes manipulation checks?

A) They are usually given after all of the dependent variables have been collected.
B) They help determine whether the manipulation has unwittingly caused differences on confounding variables.
C) They are always given before the dependent variables have been collected.
D) They are designed to influence responses on the dependent measure.

Question 26

The extent to which the experimental manipulation involves the participants in the research is called

A) a research design.
B) baseline.
C) experimental realism.
D) internal analysis.

Question 27

When a participant's expectation about what effect an experimental manipulation is supposed to have influences the dependent measure independently of the actual effect of the manipulation, the change in the dependent measure is called

A) a placebo effect.
B) an experimenter bias.
C) a confound.
D) a demand characteristic.

Question 28

Manipulation checks are

A) used to determine if the manipulation has caused differences on extraneous or confounding variables.
B) useful for interpreting the results when there is no significant relationship found between the independent and dependent variables.
C) false statements about what is being studied.
D) best presented before the dependent measure is assessed.

Question 29

When the experimental manipulation creates the hoped-for changes in the conceptual variable, it is said to have

A) impact.
B) internal validity.
C) experimental bias.
D) internal realism.

Question 30

Experimental realism is the extent to which

A) the experiment looks like it could actually work.
B) the experimental manipulation involves the participants in the research.
C) the researcher really acts like he or she cares about the participants during the experiment.
D) the researcher can give a good cover story in an experiment.

Question 31

Which of the following is NOT a necessary goal for the creation of a valid experimental manipulation?

A) Impact
B) The creation of initial equivalence
C) Standardization of conditions
D) Matching of groups

Question 32

An artifact refers to which of the following?

A) An initial measurement of the dependent variable in a before-after design
B) A measure used to determine whether the manipulation has caused a different confounding variable
C) An aspect of the research methodology that may produce confounding
D) An analysis in which the manipulation check is correlated with the dependent measure

Question 33

In a one-way experiment testing the influence of mood states on performance, the manipulation check will be a measure of

A) mood.
B) performance.
C) self-esteem.
D) anxiety.

Question 34

Pilot testing before conducting an experiment helps to be sure that

A) the independent variables will be interpreted as expected.
B) the manipulation checks will show the same patterns as the confound checks.
C) participants will be able to understand the research hypothesis.
D) the cover story is not necessary.

Question 35

Which of the following refers to a measured variable used to determine whether the manipulation has unwittingly caused differences on other variables that might be systematically related to the independent variable?

A) Artifactual variable
B) Confound check
C) Experimental realism
D) Manipulation check

Question 36

Which of the following best describes confound checks?

A) They are given before any of the dependent variables have been collected.
B) They help determine whether the manipulation has unwittingly caused differences on other variables that we did not desire to manipulate.
C) They are not usually given to all participants in all conditions.
D) They are expected to influence responses on the dependent measure.

Question 37

Manipulation checks are particularly useful

A) when there is no significant relationship found between the independent and dependent variable.
B) when there are many dependent measures.
C) when there are many manipulations.
D) when there is confounding in the experiment.

Question 38

Which of the following refers to an artifact that occurs when participants' expectations about what effect an experimental manipulation is supposed to have influences the dependent measure independently of the actual effect of the manipulation?

A) Experimental impact
B) Experimental realism
C) Placebo effect
D) Attrition

Question 39

Cover stories are most likely to be used to prevent which of the following?

A) Experimenter bias
B) Placebo effects
C) Confounding
D) Demand characteristics

Question 40

Which of the following refers to a false or misleading statement given by the experimenter about what is being studied that is used to reduce the possibility of demand characteristics?

A) Cover story
B) Confound check
C) Alternative explanation
D) Experimental script

Question 41

A potential problem with random assignment to conditions is that

A) subjects can predict what group they will be placed in.
B) experimental bias may be increased.
C) statistical significance is more difficult to assess.
D) unless blocked random assignment is used, confounding can still occur.

Question 42

Experimenter bias refers to

A) the mistreatment of participants.
B) the participants' interpretation of the experimental manipulation.
C) differences in the participants' responses to the experimental manipulation.
D) differences in how the experimenter treats the participants.

Question 43

Why would a researcher most likely use a "blind" experimenter?

A) To decrease experimental bias
B) To increase demand characteristics
C) To eliminate the need for two control groups
D) To test extrasensory perception

Question 44

Tova is participating in a study involving media awareness and conformity. After viewing a short film she fills out a conformity questionnaire. As Tova fills out the questionnaire, the questions lead her to guess that the research hypothesis is that the film will increase conformity. In this case the questions serve as a

A) suspicion check.
B) demand characteristics.
C) confound check.
D) naturalistic effect.

Question 45

Researchers who do not know the research hypothesis are known as

A) artifact-free experimenters.
B) baseline experimenters.
C) blind experimenters.
D) naive experimenters.

Question 46

Patricia is told by the experimenter that the lights in the experimental room may put people in a positive mood. Although the lights do not actually have any effect on mood, Patricia nevertheless begins to feel a positive mood. The change in mood probably represents which of the following?

A) A pilot test effect
B) A manipulation check
C) A placebo effect
D) A baseline mood effect

Question 47

A threat to internal validity that refers to the fact that the researcher knows the research hypothesis and thus causes an invalid confirmation of the research hypothesis is known as

A) a demand characteristic.
B) experimenter bias.
C) a placebo effect.
D) an informed experimenter effect.

Question 48

Which of the following procedures would be likely to reduce experimenter bias?

A) Using experimenters who know the hypothesis
B) Keeping experimenters "blind to condition"
C) Using more than one dependent measure
D) Increasing external validity

Question 49

Elliot and Niesta (2008) tested the hypothesis that men would find a woman more attractive when she was surrounded by a red background than when she was surrounded by other colors. In their first study the researchers compared a woman in front of a red background and a woman in front of a white background. The possibility that in this study the white background was brighter than the red background represents which of the following?

A) A secondary variable.
B) An alternative explanation.
C) A threat to construction validity.
D) A threat to external validity.

Question 50

Which of the types of validity is threatened when a researcher commits a Type 1 or Type 2 error?

A) Construct validity
B) Statistical conclusion validity
C) Internal validity
D) External validity

Question 51

In a study manipulating levels of aggression, participants are asked to complete a Likert Scale indicating their current state of aggression. This measure is given after the dependent measure has been assessed. This measure will likely serve as a

A) manipulation check.
B) suspicion check.
C) confounding variable.
D) extraneous variable.

Question 52

Before administering a manipulation designed to improve the mood of research participants, each participant completes a mood questionnaire. After the mood change is created, the participants then complete another mood questionnaire. The original questionnaire is used as a(n) __________.

A) baseline measure
B) manipulation check
C) control variable
D) alternate explanation

Question 53

Which of the following types of validity is threatened when self presentation occurs?

A) Construct validity
B) Statistical conclusion validity
C) Internal validity
D) External validity

Question 54

In a matched group research design, the participants are

A) given a resting baseline measure.
B) assigned to conditions on the basis of information collected prior to the experiment.
C) assigned to two or more similar conditions.
D) likely to experience demand effects.

Question 55

Which of the following would NOT be useful in reducing extraneous variables?

A) An experimental script
B) Automated devices
C) Controlling the length of the experimental session
D) Providing different information to each participant

Question 56

Which of the following sets of the sequential assignment of participants to four conditions represents the use of blocked random assignment to conditions?

A) 1,2,4,4,1,3,3,4
B) 1,1,2,2,3,3,4,4
C) 1,3,2,4,4,2,1,3
D) 1,2,1,3,4,4,2,3