Deck 11: Pre- and True Experimental Research Methods

Question 1

The experimental design that uses one group and a pretest and posttest is called ____________________.

A) one-group pretest posttest design
B) posttest only control group design
C) Solomon four-group design
D) one-shot case study

Answer 1

A

Question 2

Dr. Evans was surprised that many of his participants scored much lower than expected on his pretest. When he observed a significant increase in scores on the posttest, he was cautious in attributing the effect to his treatment alone. Which of the following threats to internal validity was Dr. Evans concerned about?

A) instrumentation
B) selection
C) regression
D) testing

Answer 2

C

Question 3

Which of the following is NOT one of the general categories of experimental design?

A) pseudo-experimental
B) pre-experimental
C) true experimental
D) quasi-experimental

Answer 3

A

Question 4

What is the proper order of the following designs if they are to be listed from the one with the least amount of control over variables to the most?

A) pretest posttest control group, Solomon four-group, quasi-experimental, one-group pretest posttest
B) one-group pretest posttest, quasi-experimental, pretest posttest control group, Solomon four-group
C) one-group pretest posttest, pretest posttest control group, Solomon four-group, quasi-experimental
D) quasi-experimental, one-group pretest posttest, pretest posttest control group, Solomon four-group

Question 5

What term is synonymous with internal validity?

A) generalizability
B) accuracy
C) reliability
D) control

Question 6

Experimental research methods are used _______________________.

A) to describe some aspect of a certain variable
B) to establish a cause and effect relationship
C) to describe trends in education
D) only in biological and physical sciences

Question 7

What is an example of a true experimental design?

A) pretest posttest control group design
B) one-group pretest posttest design
C) one-shot case study design
D) nonequivalent control group design

Question 8

Which is a threat to external validity?

A) history
B) selection
C) pretest sensitization
D) regression

Question 9

What does the term ANCOVA mean?

A) analysis of coverage
B) analysis of covariance
C) analysis of covenant
D) analysis of covalence

Question 10

In an experimental research study, which group does NOT receive treatment?

A) control group
B) experimental group
C) research group
D) participants groups

Question 11

Susan has twelve subjects drop out of her study. Which threat to internal validity must she consider?

A) mortality
B) history
C) selection
D) randomization

Question 12

Jim was coming down with a cold and decided to take his friend's advice and drink hot lemon juice with a dash of salt to help his throat. Jim's experimentation can be categorized as what type of research?

A) one-group pretest posttest design
B) quasi-experimental
C) one-shot case study
D) pretest posttest control group design

Question 13

In which of the following is randomization NOT possible?

A) selection of a sample from the population
B) assignment of participants to groups
C) post-testing of participants
D) assignment of treatment type to groups

Question 14

Which is a threat to internal validity?

A) multiple treatment interference
B) maturation
C) experimenter effects
D) reactive arrangements

Question 15

True experimental designs are NOT characterized by ______________________________.

A) random selection from the population
B) random assignment to different groups
C) control groups
D) descriptive statistics

Question 16

To what does the term internal validity refer?

A) the degree to which results of a study can be generalized from one sample to another
B) the process of subject selection
C) the development of a treatment
D) the degree to which the results of a study can be attributed to the manipulation of the independent variable

Question 17

Most threats to ____________________ are taken care of by the experiment's design, while most threats to _____________________ need to be taken care of by the designer of the experiment.

A) internal validity, external validity
B) external validity, internal validity
C) randomization, reliability
D) reliability, randomization

Question 18

The experimental design that uses one group, a treatment, and a posttest is called ________________.

A) one-shot case study design
B) pretest posttest control group design
C) Solomon four-group design
D) one-group pretest posttest design

Question 19

Which will NOT help control for extraneous variables?

A) using a control group
B) randomization
C) matching of subjects
D) using homogenous groups

Question 20

Which design uses no control group and no random selection?

A) true experimental
B) quasi-experimental
C) pre-experimental
D) causal-comparative

Question 21

What is the Hawthorne effect?

Question 22

What are the steps involved in using the pretest posttest control group design?

Question 23

Explain the effects of regression and how it affects internal validity.

Question 24

What is the difference between internal and external validity?

Question 25

Which is a way to control extraneous variables?

A) matching
B) history
C) instrumentation
D) reactive arrangements

Question 26

How can you increase internal and external validity?

Question 27

Choose one threat to internal validity, define and describe it then discuss what a researcher can do to avoid or minimize it.

Question 28

Analysis of Covariance is

A) a homogeneous population.
B) a procedure that ensures external validity.
C) a statistical tool that equalizes any initial differences that might exist between study participants.
D) equal to B/x*y.

Question 29

Choose one threat to external validity, define and describe it, then discuss what a researcher can do to avoid or minimize it.

Question 30

Which of the following threats to external validity happens when subjects receive unintended treatments?

A) reactive arrangements
B) multiple treatment interference
C) experimenter effects
D) pretest sensitization

Question 31

The Persian Gulf War might influence internal validity in what way?

A) maturation
B) history
C) selection
D) randomization

Question 32

Which of the following threats to external validity occur if the researcher interacts differently with different subjects?

A) reactive arrangements
B) multiple treatment interference
C) experimenter effects
D) pretest sensitization

Question 33

What characteristics of pre-experimental designs make it difficult to establish cause-and-effect relationships?

Question 34

Besides randomization, which of the following is a technique used to equalize initial group differences?

A) using heterogeneous population
B) comparing males and females
C) using analysis of covariance
D) ignoring extraneous variables

Question 35

Many researchers devise "sham" treatments for their control groups to undergo, meaning that the control group interacts with researchers in some way that is not thought to impact the dependent variable, or the outcome. This is done to weaken the argument that the treatment group improvement may have occurred in part simply due to the attention this group received from the researchers. These researchers are attempting to control for which of the following?

A) multiple treatment interference
B) the Hawthorne effect
C) selection
D) experimenter effects

Question 36

Which of the following threats to external validity happens when subjects discover the experiment's purpose?

A) reactive arrangements
B) multiple treatment interference
C) experimenter effects
D) pretest sensitization

Question 37

What is one disadvantage of the Solomon four-group design?

A) It lacks a control group.
B) You have to pretest every group.
C) It is prone to sampling error.
D) It is time-consuming.

Question 38

Which of the following threats to external validity happens when the subjects learn information based on the pretest?

A) reactive arrangements
B) multiple treatment interference
C) experimenter effects
D) pretest sensitization

Question 39

Which experimental design involves one experimental group and three control groups?

A) Solomon four-group design
B) pretest posttest control group design
C) posttest only control group design
D) quasi-experimental design

Question 40

What type of threat to internal validity is associated with practice effects?

A) maturation
B) regression
C) testing
D) instrumentation

Question 41

What are three methods you can use to control extraneous variables?