Question 1

Describe the factors that should be considered in determining whether an evaluation program had the desired impact.

Accepted Answer

There are several factors that should be

Question 2

Explain why the nonequivalent control group design is commonly used in evaluation research.

Accepted Answer

The nonequivalent control group design i

Question 3

Dr. Chou is conducting a program evaluation. Midway through, he realizes the program is not being implemented as it was designed. Dr. Chou's most likely based this assessment on

Accepted Answer

A)  a formative evaluation. 
B)  a survey of stakeholders. 
C)  a summative evaluation. 
D)  the theory he used to design the program. 
A)  a formative evaluation. 
B)  a survey of stakeholders. 
C)  a summative evaluation. 
D)  the theory he used to design the program.

Question 4

What is a pre-experimental research design? Describe a situation where such a design can be useful to evaluation researchers.

Accepted Answer

A pre-experimental research design is a

Question 5

Evaluation research is primarily directed at evaluating the

Accepted Answer

A)  validity of a theory. 
B)  effectiveness of a program or social intervention. 
C)  reliability and validity of a newly-developed measure. 
D)  the external validity of a research finding. 
A)  validity of a theory. 
B)  effectiveness of a program or social intervention. 
C)  reliability and validity of a newly-developed measure. 
D)  the external validity of a research finding.

Question 6

The term ________ refers to the particular group of people a program evaluation is intended to reach.

Accepted Answer

A)  stakeholders 
B)  target population 
C)  local historians 
D)  opinion leaders 
A)  stakeholders 
B)  target population 
C)  local historians 
D)  opinion leaders

Question 7

Program X has been shown to be effective in reducing teenage pregnancies, so a researcher wants to implement the program in a local high school. What questions can she ask to determine if the program will be acceptable to the school's stakeholders?

Accepted Answer

A)  Will the students' parents approve of the program? 
B)  Are qualified staff available? 
C)  Are other programs equally effective? 
D)  All of the above 
A)  Will the students' parents approve of the program? 
B)  Are qualified staff available? 
C)  Are other programs equally effective? 
D)  All of the above

Question 8

As part of the goal specification process, evaluation researchers should specify all of the following EXCEPT

Accepted Answer

A)  when in the program the expected effects should appear. 
B)  the size of the expected effects. 
C)  the expected cost of administering the program. 
D)  how long the program's effects should last. 
A)  when in the program the expected effects should appear. 
B)  the size of the expected effects. 
C)  the expected cost of administering the program. 
D)  how long the program's effects should last.

Question 9

Which of the following is generally NOT an outcome assessed in evaluation research?

Accepted Answer

A)  emotions: how clients should feel after participating in the program 
B)  knowledge: what clients should know after participating in the program 
C)  behavior: what clients should do after participating in the program 
D)  attitudes: what clients should believe after participating in the program 
A)  emotions: how clients should feel after participating in the program 
B)  knowledge: what clients should know after participating in the program 
C)  behavior: what clients should do after participating in the program 
D)  attitudes: what clients should believe after participating in the program

Question 10

Name three possible sources of null results for a program evaluation. How would conclusions about a program's effectiveness differ depending on the identified source of the null result?

Accepted Answer

Three possible sources of null results f

Question 11

Dr. Kuh has designed a program to help first generation college students succeed in their first semester. A distal outcome would be

Accepted Answer

A)  first-term midterm grades of a C or better. 
B)  higher graduation rates. 
C)  improved first-semester class attendance. 
D)  all of the above 
A)  first-term midterm grades of a C or better. 
B)  higher graduation rates. 
C)  improved first-semester class attendance. 
D)  all of the above

Question 12

Briefly describe a research question that could be answered using evaluation research.

Accepted Answer

Evaluation research is a type of researc

Question 13

Name three possible sources of potential problems to be addressed by an evaluation research study.

Accepted Answer

Evaluation research studies are designed

Question 14

Describe two situations that allow an evaluation researcher to use random assignment to conditions, even if other situational factors cannot be controlled.

Accepted Answer

Random assignment to conditions is a pow

Question 15

Resistance to a program can come from

Accepted Answer

A)  staff who do not believe in its effectiveness. 
B)  groups outside the program who feel threatened by it. 
C)  a target population that distrusts programs sponsored by outside agencies. 
D)  any of the above. 
A)  staff who do not believe in its effectiveness. 
B)  groups outside the program who feel threatened by it. 
C)  a target population that distrusts programs sponsored by outside agencies. 
D)  any of the above.

Question 16

A cost-benefit analysis compares the monetary cost of operating a program to the

Accepted Answer

A)  intangible benefits provided by the program. 
B)  monetary equivalent of the benefits provided by the program. 
C)  intangible costs of operating a program (such as stress experienced by program staff) 
D)  staff's resistance to the time it takes to implement the program. 
A)  intangible benefits provided by the program. 
B)  monetary equivalent of the benefits provided by the program. 
C)  intangible costs of operating a program (such as stress experienced by program staff) 
D)  staff's resistance to the time it takes to implement the program.

Question 17

Is an effective program that is not continued a failure? Explain your reasoning.

Accepted Answer

No, an effective program that is not con

Question 18

Which design would best answer the question "Is this program more effective than another program?"

Accepted Answer

A)  program package 
B)  client and program variation 
C)  constructive 
D)  comparative outcome 
A)  program package 
B)  client and program variation 
C)  constructive 
D)  comparative outcome

Question 19

In the context of program evaluation, implementation failure means that

Accepted Answer

A)  the researcher chose inappropriate operational definitions of the measured variables. 
B)  the program being evaluated was not carried out as designed. 
C)  the program was approved by policy-makers but not by funding agencies. 
D)  not enough data were available to allow an adequate evaluation of the program. 
A)  the researcher chose inappropriate operational definitions of the measured variables. 
B)  the program being evaluated was not carried out as designed. 
C)  the program was approved by policy-makers but not by funding agencies. 
D)  not enough data were available to allow an adequate evaluation of the program.

Question 20

Control group contamination can occur when

Accepted Answer

A)  participants in the control group learn about the treatment being given to the experimental group and try to apply it to themselves. 
B)  practitioners working with the placebo control group actually administer a treatment. 
C)  members of the control group feel a rivalry with members of the experimental group. 
D)  any of the above situations occur. 
A)  participants in the control group learn about the treatment being given to the experimental group and try to apply it to themselves. 
B)  practitioners working with the placebo control group actually administer a treatment. 
C)  members of the control group feel a rivalry with members of the experimental group. 
D)  any of the above situations occur.

Describe the factors that should be considered in determining whether an evaluation program had the desired impact.

Explain why the nonequivalent control group design is commonly used in evaluation research.

Dr. Chou is conducting a program evaluation. Midway through, he realizes the program is not being implemented as it was designed. Dr. Chou's most likely based this assessment on

What is a pre-experimental research design? Describe a situation where such a design can be useful to evaluation researchers.

Evaluation research is primarily directed at evaluating the

The term ________ refers to the particular group of people a program evaluation is intended to reach.

Program X has been shown to be effective in reducing teenage pregnancies, so a researcher wants to implement the program in a local high school. What questions can she ask to determine if the program will be acceptable to the school's stakeholders?

As part of the goal specification process, evaluation researchers should specify all of the following EXCEPT

Which of the following is generally NOT an outcome assessed in evaluation research?

Name three possible sources of null results for a program evaluation. How would conclusions about a program's effectiveness differ depending on the identified source of the null result?

Dr. Kuh has designed a program to help first generation college students succeed in their first semester. A distal outcome would be

Briefly describe a research question that could be answered using evaluation research.

Name three possible sources of potential problems to be addressed by an evaluation research study.

Describe two situations that allow an evaluation researcher to use random assignment to conditions, even if other situational factors cannot be controlled.

Resistance to a program can come from

A cost-benefit analysis compares the monetary cost of operating a program to the

Is an effective program that is not continued a failure? Explain your reasoning.

Which design would best answer the question "Is this program more effective than another program?"

In the context of program evaluation, implementation failure means that

Control group contamination can occur when

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

Describe the factors that should be considered in determining whether an evaluation program had the desired impact.

Explain why the nonequivalent control group design is commonly used in evaluation research.

Dr. Chou is conducting a program evaluation. Midway through, he realizes the program is not being implemented as it was designed. Dr. Chou's most likely based this assessment on

What is a pre-experimental research design? Describe a situation where such a design can be useful to evaluation researchers.

Evaluation research is primarily directed at evaluating the

The term ________ refers to the particular group of people a program evaluation is intended to reach.

Program X has been shown to be effective in reducing teenage pregnancies, so a researcher wants to implement the program in a local high school. What questions can she ask to determine if the program will be acceptable to the school's stakeholders?

As part of the goal specification process, evaluation researchers should specify all of the following EXCEPT

Which of the following is generally NOT an outcome assessed in evaluation research?

Name three possible sources of null results for a program evaluation. How would conclusions about a program's effectiveness differ depending on the identified source of the null result?

Dr. Kuh has designed a program to help first generation college students succeed in their first semester. A distal outcome would be

Briefly describe a research question that could be answered using evaluation research.

Name three possible sources of potential problems to be addressed by an evaluation research study.

Describe two situations that allow an evaluation researcher to use random assignment to conditions, even if other situational factors cannot be controlled.

Resistance to a program can come from

A cost-benefit analysis compares the monetary cost of operating a program to the

Is an effective program that is not continued a failure? Explain your reasoning.

Which design would best answer the question "Is this program more effective than another program?"

In the context of program evaluation, implementation failure means that

Control group contamination can occur when

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters