Question 1

A researcher who wants to conduct a study in the local high school finds that she must use volunteers rather than intact class groups.In this case, the researcher should

Accepted Answer

A)  make sure to use a sample of at least 30 or more subjects. 
B)  control for the subjects' willingness to volunteer. 
C)  keep the volunteer subjects naive as to the purpose of the study. 
D)  determine the extent to which volunteers may differ from nonvolunteers on important variables. 
A)  make sure to use a sample of at least 30 or more subjects. 
B)  control for the subjects' willingness to volunteer. 
C)  keep the volunteer subjects naive as to the purpose of the study. 
D)  determine the extent to which volunteers may differ from nonvolunteers on important variables. D

Question 2

How would you distinguish between construct validity of tests (measurement) and construct validity of experiments.

Accepted Answer

Construct validity refers to the extent to which a test or experiment measures the theoretical construct or concept it claims to measure. In the context of tests (measurement), construct validity refers to the degree to which the test accurately assesses the intended construct or concept. This involves examining whether the test items or questions are representative of the construct and whether the test produces consistent and reliable results.

On the other hand, in the context of experiments, construct validity refers to the degree to which the experimental manipulation or treatment actually measures the intended construct or concept. This involves ensuring that the independent variable (the factor being manipulated) is a valid representation of the construct being studied, and that it accurately reflects the real-world phenomenon or theoretical concept under investigation.

To distinguish between construct validity of tests and construct validity of experiments, it is important to consider the specific focus of each. In the case of tests, the focus is on the accuracy and representativeness of the test items in measuring the construct. In the case of experiments, the focus is on the accuracy and representativeness of the experimental manipulation in measuring the construct.

In summary, while both construct validity of tests and construct validity of experiments are concerned with measuring theoretical constructs or concepts, the former focuses on the accuracy of test items, while the latter focuses on the accuracy of experimental manipulations in representing the construct.

Question 3

Exhibit 10-9: Identify the threats to internal validity illustrated in the examples below.
-Refer to Exhibit 10-9.More low achievers than other students drop out of an individualized reading program designed to lead to gains in reading achievement.

Accepted Answer

A)  experimental mortality 
B)  reactive effect of testing 
C)  statistical regression 
D)  maturation 
E)  instrumentation 
A)  experimental mortality 
B)  reactive effect of testing 
C)  statistical regression 
D)  maturation 
E)  instrumentation A

Question 4

Exhibit 10-8: Choose the term that is described in each of the phrases below.
-Refer to Exhibit 10-8.Assigns subjects randomly to groups after subjects are paired on qualities that could affect the dependent variable.

Accepted Answer

A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls 
A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls

Question 5

An internal validity threat in which the researcher's expectations concerning the outcome of an experiment actually contribute to producing certain outcomes is known as the ____ effect.

Accepted Answer

A)  Hawthorne 
B)  John Henry 
C)  Diffusion 
D)  Pygmalion 
E)  Experimenter effect 
A)  Hawthorne 
B)  John Henry 
C)  Diffusion 
D)  Pygmalion 
E)  Experimenter effect

Question 6

Exhibit 10-2: In its simplest form, an experiment has three characteristics.Choose the characteristic that corresponds with each example.
-Refer to Exhibit 10-2.Two classes were randomly selected and randomly assigned to be the experimental and control groups.

Accepted Answer

A)  The effect of the independent variable is measured through observation of the dependent variable. 
B)  Extraneous variables are held constant. 
C)  An independent variable is manipulated. 
A)  The effect of the independent variable is measured through observation of the dependent variable. 
B)  Extraneous variables are held constant. 
C)  An independent variable is manipulated.

Question 7

Exhibit 10.1: A third grade teacher feels that vocabulary instruction will help her children improve their reading scores.Half of her class receives vocabulary instruction, while the other half has a library period.She will compare reading scores after four months.
-Refer to Exhibit 10-1.The control group would be those who

Accepted Answer

A)  are in the class. 
B)  are willing to cooperate in the research. 
C)  have a library period. 
D)  have high grade averages in reading. 
E)  receive vocabulary instruction. 
A)  are in the class. 
B)  are willing to cooperate in the research. 
C)  have a library period. 
D)  have high grade averages in reading. 
E)  receive vocabulary instruction.

Question 8

The factor most crucial in determining the effectiveness of the matching procedure for developing equivalent groups is whether

Accepted Answer

A)  the matching variable is significantly related to the study's dependent variable. 
B)  the matching variables were assigned to both groups. 
C)  the sample is random and representative of the larger population. 
D)  the study is causal-comparative or experimental. 
A)  the matching variable is significantly related to the study's dependent variable. 
B)  the matching variables were assigned to both groups. 
C)  the sample is random and representative of the larger population. 
D)  the study is causal-comparative or experimental.

Question 9

Exhibit 10-8: Choose the term that is described in each of the phrases below.
-Refer to Exhibit 10-8.All subjects receive all of the experimental treatments.

Accepted Answer

A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls 
A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls

Question 10

Which variable does the experimental researcher manipulate?

Accepted Answer

A)  Independent 
B)  Attribute 
C)  Extraneous 
D)  Dependent 
A)  Independent 
B)  Attribute 
C)  Extraneous 
D)  Dependent

Question 11

Counterbalancing is a technique that controls for

Accepted Answer

A)  lack of random assignment. 
B)  failure to use a double blind technique. 
C)  experimenter effect. 
D)  order and carryover effects. 
E)  diffusion. 
A)  lack of random assignment. 
B)  failure to use a double blind technique. 
C)  experimenter effect. 
D)  order and carryover effects. 
E)  diffusion.

Question 12

Exhibit 10-6: Choose the intersubject difference control that best corresponds with the following statements.
-Refer to Exhibit 10-6.Last year's math grades are taken into consideration when analyzing the posttest scores following the use of a new math teaching method.

Accepted Answer

A)  ANCOVA 
B)  Homogeneous selection 
C)  Randomized matching 
D)  Random assignment 
E)  Use subjects as their own controls 
A)  ANCOVA 
B)  Homogeneous selection 
C)  Randomized matching 
D)  Random assignment 
E)  Use subjects as their own controls

Question 13

Exhibit 10.1: A third grade teacher feels that vocabulary instruction will help her children improve their reading scores.Half of her class receives vocabulary instruction, while the other half has a library period.She will compare reading scores after four months.
-Refer to Exhibit 10-1.Suppose the group with vocabulary instruction ends up with statistically higher reading scores than those without vocabulary training.Assuming that there are no problems of internal validity, the teacher should

Accepted Answer

A)  reject the null hypothesis. 
B)  retain the null hypothesis. 
C)  reject the experimental hypothesis. 
D)  declare the hypothesis as proven. 
A)  reject the null hypothesis. 
B)  retain the null hypothesis. 
C)  reject the experimental hypothesis. 
D)  declare the hypothesis as proven.

Question 14

Exhibit 10-5: Choose the internal validity problem that is associated with the situations listed.
-Refer to Exhibit 10-5.Entirely a function of the passage of time

Accepted Answer

A)  history 
B)  maturation 
C)  experimenter effect 
D)  statistical regression 
E)  diffusion 
A)  history 
B)  maturation 
C)  experimenter effect 
D)  statistical regression 
E)  diffusion

Question 15

Exhibit 10-8: Choose the term that is described in each of the phrases below.
-Refer to Exhibit 10-8.Removes the part of each subject's posttest score that is in common with his/her pretest score.

Accepted Answer

A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls 
A)  random assignment 
B)  randomized matching 
C)  homogeneous selection 
D)  analysis of covariance 
E)  use of subjects as their own controls

Question 16

The variable upon which the effects of the experimental treatment are observed is called the ____variable.

Accepted Answer

A)  independent 
B)  dependent 
C)  extraneous 
D)  control 
A)  independent 
B)  dependent 
C)  extraneous 
D)  control

Question 17

Exhibit 10-10: Identify the major threat to internal validity in the following research studies.
-Refer to Exhibit 10-10.A researcher used two classrooms in an experimental study.It was found that the E group had more high ability students than the C group before the study began.

Accepted Answer

A)  Regression 
B)  Diffusion 
C)  Mortality 
D)  Selection bias 
E)  History 
A)  Regression 
B)  Diffusion 
C)  Mortality 
D)  Selection bias 
E)  History

Question 18

Which of the following is an internal validity question in experimental research?

Accepted Answer

A)  Does the sample represent the population? 
B)  Has statistical regression influenced the dependent variable? 
C)  Does the design provide adequate control of the dependent variable? 
D)  Can the experiment's results be generalized to other settings? 
E)  Is the study's cost worth the time and effort? 
A)  Does the sample represent the population? 
B)  Has statistical regression influenced the dependent variable? 
C)  Does the design provide adequate control of the dependent variable? 
D)  Can the experiment's results be generalized to other settings? 
E)  Is the study's cost worth the time and effort?

Question 19

A researcher wishes to study the effects of a concentrated remedial reading program on the reading achievement of disadvantaged children.A large number of children are available for assignment to groups.Since intelligence is an important relevant variable in any research on reading, the investigator wants to make sure that it is controlled as well as the reading pretest scores.What would be the most effective way for the researcher to control these variables?

Accepted Answer

A)  Set up groups and then check to make sure that there are no significant differences between the groups on intelligence and reading pretest scores. 
B)  Randomly assign children to experimental and control groups. 
C)  Match the children on intelligence test and reading pretest scores and then randomly assign the matched pairs to experimental and control groups. 
D)  Randomly assign children to experimental and control groups and use intelligence test and reading pretest scores in an analysis of covariance. 
A)  Set up groups and then check to make sure that there are no significant differences between the groups on intelligence and reading pretest scores. 
B)  Randomly assign children to experimental and control groups. 
C)  Match the children on intelligence test and reading pretest scores and then randomly assign the matched pairs to experimental and control groups. 
D)  Randomly assign children to experimental and control groups and use intelligence test and reading pretest scores in an analysis of covariance.

Question 20

Exhibit 10-11: Indicate whether the following statements relate to internal validity, external validity, construct validity, or statistical conclusion validity.
-Refer to Exhibit 10-11.Was the experimenter correct in reporting that the treatment had no significant effect? Would a more powerful test have lead to a different conclusion?

Accepted Answer

A)  internal validity 
B)  external validity. 
C)  construct validity 
D)  statistical conclusion validity 
A)  internal validity 
B)  external validity. 
C)  construct validity 
D)  statistical conclusion validity

A researcher who wants to conduct a study in the local high school finds that she must use volunteers rather than intact class groups.In this case, the researcher should

How would you distinguish between construct validity of tests (measurement) and construct validity of experiments.

Exhibit 10-9: Identify the threats to internal validity illustrated in the examples below. -Refer to Exhibit 10-9.More low achievers than other students drop out of an individualized reading program designed to lead to gains in reading achievement.

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.Assigns subjects randomly to groups after subjects are paired on qualities that could affect the dependent variable.

An internal validity threat in which the researcher's expectations concerning the outcome of an experiment actually contribute to producing certain outcomes is known as the ____ effect.

Exhibit 10-2: In its simplest form, an experiment has three characteristics.Choose the characteristic that corresponds with each example. -Refer to Exhibit 10-2.Two classes were randomly selected and randomly assigned to be the experimental and control groups.

The factor most crucial in determining the effectiveness of the matching procedure for developing equivalent groups is whether

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.All subjects receive all of the experimental treatments.

Which variable does the experimental researcher manipulate?

Counterbalancing is a technique that controls for

Exhibit 10-6: Choose the intersubject difference control that best corresponds with the following statements. -Refer to Exhibit 10-6.Last year's math grades are taken into consideration when analyzing the posttest scores following the use of a new math teaching method.

Exhibit 10-5: Choose the internal validity problem that is associated with the situations listed. -Refer to Exhibit 10-5.Entirely a function of the passage of time

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.Removes the part of each subject's posttest score that is in common with his/her pretest score.

The variable upon which the effects of the experimental treatment are observed is called the ____variable.

Exhibit 10-10: Identify the major threat to internal validity in the following research studies. -Refer to Exhibit 10-10.A researcher used two classrooms in an experimental study.It was found that the E group had more high ability students than the C group before the study began.

Which of the following is an internal validity question in experimental research?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Validity and Reliability

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

Exam 10: Experimental Research

A researcher who wants to conduct a study in the local high school finds that she must use volunteers rather than intact class groups.In this case, the researcher should

How would you distinguish between construct validity of tests (measurement) and construct validity of experiments.

Exhibit 10-9: Identify the threats to internal validity illustrated in the examples below. -Refer to Exhibit 10-9.More low achievers than other students drop out of an individualized reading program designed to lead to gains in reading achievement.

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.Assigns subjects randomly to groups after subjects are paired on qualities that could affect the dependent variable.

An internal validity threat in which the researcher's expectations concerning the outcome of an experiment actually contribute to producing certain outcomes is known as the ____ effect.

Exhibit 10-2: In its simplest form, an experiment has three characteristics.Choose the characteristic that corresponds with each example. -Refer to Exhibit 10-2.Two classes were randomly selected and randomly assigned to be the experimental and control groups.

The factor most crucial in determining the effectiveness of the matching procedure for developing equivalent groups is whether

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.All subjects receive all of the experimental treatments.

Which variable does the experimental researcher manipulate?

Counterbalancing is a technique that controls for

Exhibit 10-6: Choose the intersubject difference control that best corresponds with the following statements. -Refer to Exhibit 10-6.Last year's math grades are taken into consideration when analyzing the posttest scores following the use of a new math teaching method.

Exhibit 10-5: Choose the internal validity problem that is associated with the situations listed. -Refer to Exhibit 10-5.Entirely a function of the passage of time

Exhibit 10-8: Choose the term that is described in each of the phrases below. -Refer to Exhibit 10-8.Removes the part of each subject's posttest score that is in common with his/her pretest score.

The variable upon which the effects of the experimental treatment are observed is called the ____variable.

Exhibit 10-10: Identify the major threat to internal validity in the following research studies. -Refer to Exhibit 10-10.A researcher used two classrooms in an experimental study.It was found that the E group had more high ability students than the C group before the study began.

Which of the following is an internal validity question in experimental research?

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Validity and Reliability

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters