Question 1

In the ________ evaluation research design, a new component is added to a successful program to determine if it will improve goal attainment.

Accepted Answer

A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric 
A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric

Question 2

__________ are the people who have a vested interest in the program being evaluated.

Accepted Answer

A)  Evaluators 
B)  Stakeholders 
C)  Clients 
D)  Impact assessors 
A)  Evaluators 
B)  Stakeholders 
C)  Clients 
D)  Impact assessors

Question 3

The LEAST desirable design for an evaluation research study is

Accepted Answer

A)  qualitative. 
B)  true experimental. 
C)  pretest-posttest design without a control group. 
D)  patched-up quasi experiment. 
A)  qualitative. 
B)  true experimental. 
C)  pretest-posttest design without a control group. 
D)  patched-up quasi experiment.

Question 4

A law was passed so that licenses were suspended for all drivers found guilty of speeding. As a result, the number of speeding violations declined but the number people driving with suspended licenses increased. A program evaluator would likely see the increase in driving under suspension as________ the law.

Accepted Answer

A)  an unintended effect of 
B)  police resistance to 
C)  a failure to implement 
D)  a low stakes outcome of 
A)  an unintended effect of 
B)  police resistance to 
C)  a failure to implement 
D)  a low stakes outcome of

Question 5

Define goal specification. Explain why it is important for an evaluation researcher to consider both the importance of goals and their consequences.

Accepted Answer

Goal specification refers to the process

Question 6

Which design would best answer this question: "How generalizable are the effects of the program?"

Accepted Answer

A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric 
A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric

Question 7

Name four groups who are common stakeholders in evaluation research and then identify their roles in this process. Why is it important to consider the different goals and expectations these stakeholders might have?

Accepted Answer

Four common groups of stakeholders in ev

Question 8

Which of the following group members would NOT be considered stakeholders in a program?

Accepted Answer

A)  the people who designed the program 
B)  opinion leaders in the community where the program is being implemented 
C)  the researchers conducting the evaluation 
D)  policy makers who decide whether the program should continue to be funded. 
A)  the people who designed the program 
B)  opinion leaders in the community where the program is being implemented 
C)  the researchers conducting the evaluation 
D)  policy makers who decide whether the program should continue to be funded.

Question 9

Ritual evaluations

Accepted Answer

A)  focus on the informal social processes taking place in the program being evaluated. 
B)  deal with spiritual outcomes rather than material outcomes of a program. 
C)  are carried out even though no one has any intention of applying the results to the program. 
D)  are carried out on a set schedule that is mandated by funding agencies. 
A)  focus on the informal social processes taking place in the program being evaluated. 
B)  deal with spiritual outcomes rather than material outcomes of a program. 
C)  are carried out even though no one has any intention of applying the results to the program. 
D)  are carried out on a set schedule that is mandated by funding agencies.

Question 10

Which of the following statements about the role theory plays in program evaluation is TRUE?

Accepted Answer

A)  Because programs are applications of psychology, theory has no role to play in them. 
B)  Theories can be consulted at the project design stage, but they play no role in the implementation stage. 
C)  The cost of conducting theory-based evaluations usually exceed the benefits of doing so. 
D)  If a program is based on a theory, the evaluation can function as a test of that theory. 
A)  Because programs are applications of psychology, theory has no role to play in them. 
B)  Theories can be consulted at the project design stage, but they play no role in the implementation stage. 
C)  The cost of conducting theory-based evaluations usually exceed the benefits of doing so. 
D)  If a program is based on a theory, the evaluation can function as a test of that theory.

Question 11

A non-profit organization wants to evaluate the effectiveness of their AIDS prevention program. They hire Dr. Joyeaux to assist them and he raises the concern that the program is being delivered to the wrong people. Which program goal is he addressing?

Accepted Answer

A)  identifying potential causes 
B)  identifying the client population 
C)  evaluability assessment 
D)  needs assessment 
A)  identifying potential causes 
B)  identifying the client population 
C)  evaluability assessment 
D)  needs assessment

Question 12

What is a client and program variation design? What information does this design offer researchers about the program's effectiveness?

Accepted Answer

A client and program variation design is

Question 13

Dr. Smith uses the results of a program evaluation to influence a policy maker's thinking about an issue, even though he does not expect it will directly influence any upcoming decisions. He has engaged in _________ utilization of the evaluation results.

Accepted Answer

A)  persuasive 
B)  conceptual 
C)  instrumental 
D)  relevance 
A)  persuasive 
B)  conceptual 
C)  instrumental 
D)  relevance

Question 14

The goal specification process includes all of the following EXCEPT

Accepted Answer

A)  operationally defining the program's goals. 
B)  prioritizing the program's goals. 
C)  identifying both proximal and distal outcomes. 
D)  identifying the value of the program's goals relative to their expected cost. 
A)  operationally defining the program's goals. 
B)  prioritizing the program's goals. 
C)  identifying both proximal and distal outcomes. 
D)  identifying the value of the program's goals relative to their expected cost.

Question 15

Which of the following is NOT necessary for conducting a proper program evaluation?

Accepted Answer

A)  identifying the program goals 
B)  designing a program that will have the desired consequences. 
C)  identifying a theory that links the elements of the program to the expected outcomes 
D)  the ability to randomly assign members of the client population to treatment and control conditions 
A)  identifying the program goals 
B)  designing a program that will have the desired consequences. 
C)  identifying a theory that links the elements of the program to the expected outcomes 
D)  the ability to randomly assign members of the client population to treatment and control conditions

Question 16

Name two research questions that program evaluators can answer using meta-analysis.

Accepted Answer

Meta-analysis is a statistical technique

Question 17

In evaluation research, which of the following determines the information needed to conduct an evaluation?

Accepted Answer

A)  needs assessment 
B)  impact evaluation 
C)  program monitoring 
D)  evaluability assessment 
A)  needs assessment 
B)  impact evaluation 
C)  program monitoring 
D)  evaluability assessment

Question 18

Distal program outcomes are

Accepted Answer

A)  under the direct control of the program. 
B)  indicators of the program's ecological validity. 
C)  unrelated to proximal outcomes. 
D)  usually the least important of a program's outcomes. 
A)  under the direct control of the program. 
B)  indicators of the program's ecological validity. 
C)  unrelated to proximal outcomes. 
D)  usually the least important of a program's outcomes.

Question 19

Which of the following questions can be addressed by evaluation research?

Accepted Answer

A)  To what extent did the program achieve its goals? 
B)  How can the program be improved? 
C)  How valid is the theory underlying the program? 
D)  all of the above 
A)  To what extent did the program achieve its goals? 
B)  How can the program be improved? 
C)  How valid is the theory underlying the program? 
D)  all of the above

Question 20

Distinguish between proximal and distal outcomes in evaluation research and give an example of each.

Accepted Answer

In evaluation research, proximal outcome

In the ________ evaluation research design, a new component is added to a successful program to determine if it will improve goal attainment.

__________ are the people who have a vested interest in the program being evaluated.

The LEAST desirable design for an evaluation research study is

Define goal specification. Explain why it is important for an evaluation researcher to consider both the importance of goals and their consequences.

Which design would best answer this question: "How generalizable are the effects of the program?"

Name four groups who are common stakeholders in evaluation research and then identify their roles in this process. Why is it important to consider the different goals and expectations these stakeholders might have?

Which of the following group members would NOT be considered stakeholders in a program?

Ritual evaluations

Which of the following statements about the role theory plays in program evaluation is TRUE?

A non-profit organization wants to evaluate the effectiveness of their AIDS prevention program. They hire Dr. Joyeaux to assist them and he raises the concern that the program is being delivered to the wrong people. Which program goal is he addressing?

What is a client and program variation design? What information does this design offer researchers about the program's effectiveness?

Dr. Smith uses the results of a program evaluation to influence a policy maker's thinking about an issue, even though he does not expect it will directly influence any upcoming decisions. He has engaged in _________ utilization of the evaluation results.

The goal specification process includes all of the following EXCEPT

Which of the following is NOT necessary for conducting a proper program evaluation?

Name two research questions that program evaluators can answer using meta-analysis.

In evaluation research, which of the following determines the information needed to conduct an evaluation?

Distal program outcomes are

Which of the following questions can be addressed by evaluation research?

Distinguish between proximal and distal outcomes in evaluation research and give an example of each.

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

In the ________ evaluation research design, a new component is added to a successful program to determine if it will improve goal attainment.

__________ are the people who have a vested interest in the program being evaluated.

The LEAST desirable design for an evaluation research study is

Define goal specification. Explain why it is important for an evaluation researcher to consider both the importance of goals and their consequences.

Which design would best answer this question: "How generalizable are the effects of the program?"

Name four groups who are common stakeholders in evaluation research and then identify their roles in this process. Why is it important to consider the different goals and expectations these stakeholders might have?

Which of the following group members would NOT be considered stakeholders in a program?

Ritual evaluations

Which of the following statements about the role theory plays in program evaluation is TRUE?

A non-profit organization wants to evaluate the effectiveness of their AIDS prevention program. They hire Dr. Joyeaux to assist them and he raises the concern that the program is being delivered to the wrong people. Which program goal is he addressing?

What is a client and program variation design? What information does this design offer researchers about the program's effectiveness?

Dr. Smith uses the results of a program evaluation to influence a policy maker's thinking about an issue, even though he does not expect it will directly influence any upcoming decisions. He has engaged in _________ utilization of the evaluation results.

The goal specification process includes all of the following EXCEPT

Which of the following is NOT necessary for conducting a proper program evaluation?

Name two research questions that program evaluators can answer using meta-analysis.

In evaluation research, which of the following determines the information needed to conduct an evaluation?

Distal program outcomes are

Which of the following questions can be addressed by evaluation research?

Distinguish between proximal and distal outcomes in evaluation research and give an example of each.

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters