Question 1

McDavid, Huse, and Hawthorne (2013) identify key features that are important in distinguishing impact program evaluation for performance measurement: Which of the following is NOT included in that list?

Accepted Answer

A)  Frequency 
B)  Issue 
C)  reporting of results 
D)  Attribution of outcomes

Question 2

An impact program evaluation is a hypothesis-testing activity. Using a domestic violence example, which of the following statements is NOT correct?

Accepted Answer

A)  Then a woman would successfully leave her abusive partner 
B)  If we could identify the major barriers 
C)  If we could successfully eliminate or reduce those barriers with a well-designed and well-implemented human service program 
D)  Then we should see a positive change in participant's lives and an increase in self-sufficiency

Question 3

An impact program evaluation seeks to establish a cause-and-effect relationship between a program and its outcome (result).

Accepted Answer

A) True 
 B)False

Question 4

The strongest impact research design and the one that deals most strongly with threats to internal validity is the single group pretest/posttest design.

Accepted Answer

A) True 
 B)False

Question 5

In examining threats to internal validity history, selection bias and testing are described below. Which of the following is NOT a description of those threats?

Accepted Answer

A)  Events outside the program differentially affect the scores of the experimental or comparison group. 
B)  Differences in the dropout rate between the experimental group and the comparison group differentially affect effect the scores between the two groups. 
C)  Members of the experimental and comparison groups are not truly equal on all important factors. 
D)  The pretest differentially affected the learning of the experimental or comparison group.

Question 6

In an Impact Program Evaluation, which of the following statements is NOT true?

Accepted Answer

A)  Research designs vary in complexity. 
B)  Research designs vary in length. 
C)  Research designs vary in timeliness. 
D)  Research designs vary in feasibility.

Question 7

Comparisons in impact program evaluation are usually made in one of two ways: two different groups are compared or one group is compared to ___________.

Accepted Answer

The answer of Comparisons in impact program evaluation are usually...

Question 8

The essence of impact program evaluation is comparison.

Accepted Answer

A) True 
 B)False

Question 9

An impact program evaluation can demonstrate that a human service program includes all EXCEPT which of the following answers:

Accepted Answer

A)  implemented with a poor program design. 
B)  successful. 
C)  unsuccessful due to theory failure. 
D)  unsuccessful due to program failure.

Question 10

A program hypothesis does NOT do which of the following statements:

Accepted Answer

A)  makes explicit the assumptions underlining a human service program outcome (result). 
B)  establishes a framework to bring internal consistency to the implementation of a human service program. 
C)  enables inputs, process, outputs (including quality outputs), and outcomes to be examined for internal consistency. 
D)  if followed by the correct program design, will result in the desired result.

Question 11

Impact program evaluation's intent is to answer the question: Does the program actually have an impact and does it achieve positive outcomes (results) for _____________.

Accepted Answer

The answer of Impact program evaluation's intent is to answer...

Question 12

A human services program director would do an impact program evaluation when there is a need to do all EXCEPT which of the following:

Accepted Answer

A)  compare two groups to determine if there is a difference between the level at which program clients show improvement. 
B)  if there can be only one point of evaluation. 
C)  to determine that the improvement is due to the program and not some external feature. 
D)  what happens to clients who participate in the program versus those who do not.

Question 13

Impact program evaluation attempts to determine if a human service program actually works. In order to make a cause-and-effect statement a counterfactual has to be created that would identify what would have happened to individuals had they not participated in the program?
You are the program director of a program that works with young women to improve their parenting skills and you are charged to evaluate the program to determine if the program has made a difference in knowledge and behaviors of the women who participated in the program. Describe 1) the program hypothesis, 2) which of the two ways that you will use to compare two groups, 3) create the cause-and-effect statement and, if necessary, create a counterfactual that identifies what would happen if participants would not have participated in the program, and 4) describe the desired result that should be the outcome of the program and how you would determine if it had been achieved.

Accepted Answer

The answer of Impact program evaluation attempts to determine if...

Question 14

Using a logic model terminology, a successful program is one where there is ___________ between the program hypothesis (theory) and implementation of the program design (cause) that produces the desired outcomes (result).

Accepted Answer

The answer of Using a logic model terminology, a successful...

Question 15

Theory failure describes a situation in which a human service program is implemented according to design, but the anticipated outcome is not achieved. Which of the features listed below does NOT describe theory failure?

Accepted Answer

A)  Comes about because of a flaw in the hypothesis underlying the program 
B)  Certain causal processes will lead directly to the desired outcome 
C)  The hypothesis is not supported when the program is implemented according to the program design, but the result is not the desired outcome 
D)  It is designed to address specific stakeholder questions

Question 16

To be able to say with more assurance that the program caused the change, we must identify threats to internal validity.

Accepted Answer

A) True 
 B)False

Question 17

Impact program evaluation attempts to demonstrate that an outcome (result) is ______________ to the program and not some other variable.

Accepted Answer

The answer of Impact program evaluation attempts to demonstrate that...

Question 18

There are several features of impact program: evaluation and performance measurement. Both share some features and some features are different. Which of the features listed below is NOT correct for performance measurement?

Accepted Answer

A)  Ongoing 
B)  Attributes of outcomes are assumed 
C)  Episodic 
D)  Designed to address more specific performance issues that are constant over time

Exam 10: Impact Program Evaluation and Hypothesis Testing

McDavid, Huse, and Hawthorne (2013) identify key features that are important in distinguishing impact program evaluation for performance measurement: Which of the following is NOT included in that list?

An impact program evaluation is a hypothesis-testing activity. Using a domestic violence example, which of the following statements is NOT correct?

An impact program evaluation seeks to establish a cause-and-effect relationship between a program and its outcome (result).

The strongest impact research design and the one that deals most strongly with threats to internal validity is the single group pretest/posttest design.

In examining threats to internal validity history, selection bias and testing are described below. Which of the following is NOT a description of those threats?

In an Impact Program Evaluation, which of the following statements is NOT true?

Comparisons in impact program evaluation are usually made in one of two ways: two different groups are compared or one group is compared to ___________.

The essence of impact program evaluation is comparison.

An impact program evaluation can demonstrate that a human service program includes all EXCEPT which of the following answers:

A program hypothesis does NOT do which of the following statements:

Impact program evaluation's intent is to answer the question: Does the program actually have an impact and does it achieve positive outcomes (results) for _____________.

A human services program director would do an impact program evaluation when there is a need to do all EXCEPT which of the following:

Using a logic model terminology, a successful program is one where there is ___________ between the program hypothesis (theory) and implementation of the program design (cause) that produces the desired outcomes (result).

Theory failure describes a situation in which a human service program is implemented according to design, but the anticipated outcome is not achieved. Which of the features listed below does NOT describe theory failure?

To be able to say with more assurance that the program caused the change, we must identify threats to internal validity.

Impact program evaluation attempts to demonstrate that an outcome (result) is ______________ to the program and not some other variable.

There are several features of impact program: evaluation and performance measurement. Both share some features and some features are different. Which of the features listed below is NOT correct for performance measurement?