Question 1

Which of the graphically depicted designs from your text is NOT correct?

Accepted Answer

A)  R 01 x 02 
B)  01 02 x 
C)  01 x 02 
D)  R 03 04 
A)  R 01 x 02 
B)  01 02 x 
C)  01 x 02 
D)  R 03 04 B

Question 2

The purpose of comparison in impact program evaluation is to determine all of the following EXCEPT:

Accepted Answer

A)  what actually happens to clients as a result of client's participation in the program. 
B)  which part of the program caused the client improvement. 
C)  do program clients show improvement. 
D)  how do we know for sure that the improvement is actually due to the program and not some external factor(s). 
A)  what actually happens to clients as a result of client's participation in the program. 
B)  which part of the program caused the client improvement. 
C)  do program clients show improvement. 
D)  how do we know for sure that the improvement is actually due to the program and not some external factor(s). B

Question 3

Impact program evaluation differs from other types of evaluation in that the focus is on changes in program participants and not on changes in organizations and communities.

Accepted Answer

A) True 
 B)False  True

Question 4

The measurement or observation is related to the client characteristics. Which of the following does NOT describe a client characteristic:

Accepted Answer

A)  behavior 
B)  knowledge 
C)  time in the program 
D)  condition 
A)  behavior 
B)  knowledge 
C)  time in the program 
D)  condition

Question 5

When a program fails to achieve the desired outcome (result) due to ________________ the program has not been properly tested and we cannot make inferences about the success or failure of the program.

Accepted Answer

The answer of When a program fails to achieve the...

Question 6

There are several features of impact program: evaluation and performance measurement. Both share some features and some features are different. Which of the following is NOT correct for impact program evaluation?

Accepted Answer

A)  Attributes of outcomes are to be determined. 
B)  Attributes of outcomes are to be determined 
C)  Designed to address specific stakeholder questions at a particular point in time. 
D)  Episodic. 
A)  Attributes of outcomes are to be determined. 
B)  Attributes of outcomes are to be determined 
C)  Designed to address specific stakeholder questions at a particular point in time. 
D)  Episodic.

Question 7

The pretest and posttest design in a single group pretest/posttest design does not need to be created. It may be any test, observation, or measurement:

Accepted Answer

A) True 
 B)False

Question 8

Random assignment to groups is the least powerful in controlling for selection bias.

Accepted Answer

A) True 
 B)False

Question 9

Ethical issues such as withholding participation in a program for experimental purposes and legal requirements such as withholding participation if a client meets eligibility requirements often cause human service administrators to rely on less religious designs when conducting impact program evaluations.

Accepted Answer

A) True 
 B)False

Question 10

Statistically similar means that the characteristics of the individuals that comprise the comparison group are the same or similar to the characteristics of the individuals that comprise the experimental group on all relevant characteristics.

Accepted Answer

A) True 
 B)False

Question 11

When a human service services program fails to achieve its desired outcomes (result) due to theory failure, the results are invalid for any type of program evaluation.

Accepted Answer

A) True 
 B)False

Question 12

Which of the following is NOT a type of impact program design ?

Accepted Answer

A)  The single group pretest/posttest design 
B)  The nonequivalent comparison group design 
C)  The randomized experimental design 
D)  The single group posttest design 
A)  The single group pretest/posttest design 
B)  The nonequivalent comparison group design 
C)  The randomized experimental design 
D)  The single group posttest design

Question 13

Describe the two ways comparison in impact program evaluation is achieved and give an example of each.

Accepted Answer

1) two different groups are compared 2)

Question 14

If a hypothesis has been tested, which of thefollowing is NOT true?

Accepted Answer

A)  The program was implemented as designed. 
B)  The desired results are achieved. 
C)  The hypothesis is supported. 
D)  The hypothesis is not supported unless the participant is not self-sufficient. 
A)  The program was implemented as designed. 
B)  The desired results are achieved. 
C)  The hypothesis is supported. 
D)  The hypothesis is not supported unless the participant is not self-sufficient.

Question 15

Define theory success, theory failure. and program failure, describe the differences between them and give an example of each within a human service program.

Accepted Answer

Theory success: there is an alignment be

Question 16

The nonequivalent comparison group design begins with the issue of threats to internal validity. Which of the following is NOT correct.

Accepted Answer

A)  Two groups are tested at two different time periods. 
B)  The experimental group does not serve as its own comparison group. 
C)  Two distinct groups are created: one group becomes the experimental group where individuals will participate in the program and the other is a group is individuals who are "statistically similar to the clients participating in the program, but who will not participate in the program." 
D)  Persons who are eligible to participate in the program but cannot be served because of inadequate funding. 
A)  Two groups are tested at two different time periods. 
B)  The experimental group does not serve as its own comparison group. 
C)  Two distinct groups are created: one group becomes the experimental group where individuals will participate in the program and the other is a group is individuals who are "statistically similar to the clients participating in the program, but who will not participate in the program." 
D)  Persons who are eligible to participate in the program but cannot be served because of inadequate funding.

Question 17

An initial measurement in a single group pre-test/posttest design that includes the initial measurement of observation is called a pretest and takes place:

Accepted Answer

A)  before the program. 
B)  during the implementation of the program. 
C)  a result at the end of the program. 
D)  at any point during implementation of the program. 
A)  before the program. 
B)  during the implementation of the program. 
C)  a result at the end of the program. 
D)  at any point during implementation of the program.

Question 18

In impact program evaluation, the Treasury Board of Canada (2010) identified 7 major threats to internal validity. Which of the following is INCORRECT

Accepted Answer

A)  History 
B)  Selection bias 
C)  Using an experimental group 
D)  Testing 
A)  History 
B)  Selection bias 
C)  Using an experimental group 
D)  Testing

Question 19

An analogy that describes how random assignment works would include all EXCEPT which of the components:

Accepted Answer

A)  people standing in a line. 
B)  a coin is tossed in the air. 
C)  every other person in the line is assigned to the comparison group. 
D)  if the coin shows tails, the person is assigned to the experimental group. 
A)  people standing in a line. 
B)  a coin is tossed in the air. 
C)  every other person in the line is assigned to the comparison group. 
D)  if the coin shows tails, the person is assigned to the experimental group.

Question 20

When two groups are compared in impact program evaluation, one of the following is NOT correct:

Accepted Answer

A)  one group serves as the experimental group and the other serves as the comparison group. 
B)  a single group serves as the experimental group and also serves as the comparison group. 
C)  all groups are tested at the end of the program and the scores added and divided by the number of participants. 
D)  a counterfactual is evidence of what would have happened to participants if they were not in the program. 
A)  one group serves as the experimental group and the other serves as the comparison group. 
B)  a single group serves as the experimental group and also serves as the comparison group. 
C)  all groups are tested at the end of the program and the scores added and divided by the number of participants. 
D)  a counterfactual is evidence of what would have happened to participants if they were not in the program.

Which of the graphically depicted designs from your text is NOT correct?

The purpose of comparison in impact program evaluation is to determine all of the following EXCEPT:

Impact program evaluation differs from other types of evaluation in that the focus is on changes in program participants and not on changes in organizations and communities.

The measurement or observation is related to the client characteristics. Which of the following does NOT describe a client characteristic:

When a program fails to achieve the desired outcome (result) due to ________________ the program has not been properly tested and we cannot make inferences about the success or failure of the program.

There are several features of impact program: evaluation and performance measurement. Both share some features and some features are different. Which of the following is NOT correct for impact program evaluation?

The pretest and posttest design in a single group pretest/posttest design does not need to be created. It may be any test, observation, or measurement:

Random assignment to groups is the least powerful in controlling for selection bias.

Statistically similar means that the characteristics of the individuals that comprise the comparison group are the same or similar to the characteristics of the individuals that comprise the experimental group on all relevant characteristics.

When a human service services program fails to achieve its desired outcomes (result) due to theory failure, the results are invalid for any type of program evaluation.

Which of the following is NOT a type of impact program design ?

Describe the two ways comparison in impact program evaluation is achieved and give an example of each.

If a hypothesis has been tested, which of thefollowing is NOT true?

Define theory success, theory failure. and program failure, describe the differences between them and give an example of each within a human service program.

The nonequivalent comparison group design begins with the issue of threats to internal validity. Which of the following is NOT correct.

An initial measurement in a single group pre-test/posttest design that includes the initial measurement of observation is called a pretest and takes place:

In impact program evaluation, the Treasury Board of Canada (2010) identified 7 major threats to internal validity. Which of the following is INCORRECT

An analogy that describes how random assignment works would include all EXCEPT which of the components:

When two groups are compared in impact program evaluation, one of the following is NOT correct:

The Contribution of Theory to Program Planning

Understanding Social Problems

Needs Assessment: Theoretical Considerations

Needs Assessment: Approaches to Measurement

Selecting the Appropriate Intervention Strategy

Setting Goals and Objectives

Designing Effective Programs

Designing Effectiveness-Based Information Systems

Performance Measurement, Monitoring, and Program Evaluation

Budgeting for Financial Control, Management, and Planning

Developing Line-Item, Functional, and Program Budgeting Systems

Filters

Exam 10: Impact Program Evaluation and Hypothesis Testing

Which of the graphically depicted designs from your text is NOT correct?

The purpose of comparison in impact program evaluation is to determine all of the following EXCEPT:

Impact program evaluation differs from other types of evaluation in that the focus is on changes in program participants and not on changes in organizations and communities.

The measurement or observation is related to the client characteristics. Which of the following does NOT describe a client characteristic:

When a program fails to achieve the desired outcome (result) due to ________________ the program has not been properly tested and we cannot make inferences about the success or failure of the program.

There are several features of impact program: evaluation and performance measurement. Both share some features and some features are different. Which of the following is NOT correct for impact program evaluation?

The pretest and posttest design in a single group pretest/posttest design does not need to be created. It may be any test, observation, or measurement:

Random assignment to groups is the least powerful in controlling for selection bias.

Statistically similar means that the characteristics of the individuals that comprise the comparison group are the same or similar to the characteristics of the individuals that comprise the experimental group on all relevant characteristics.

When a human service services program fails to achieve its desired outcomes (result) due to theory failure, the results are invalid for any type of program evaluation.

Which of the following is NOT a type of impact program design ?

Describe the two ways comparison in impact program evaluation is achieved and give an example of each.

If a hypothesis has been tested, which of thefollowing is NOT true?

Define theory success, theory failure. and program failure, describe the differences between them and give an example of each within a human service program.

The nonequivalent comparison group design begins with the issue of threats to internal validity. Which of the following is NOT correct.

An initial measurement in a single group pre-test/posttest design that includes the initial measurement of observation is called a pretest and takes place:

In impact program evaluation, the Treasury Board of Canada (2010) identified 7 major threats to internal validity. Which of the following is INCORRECT

An analogy that describes how random assignment works would include all EXCEPT which of the components:

When two groups are compared in impact program evaluation, one of the following is NOT correct:

The Contribution of Theory to Program Planning

Understanding Social Problems

Needs Assessment: Theoretical Considerations

Needs Assessment: Approaches to Measurement

Selecting the Appropriate Intervention Strategy

Setting Goals and Objectives

Designing Effective Programs

Designing Effectiveness-Based Information Systems

Performance Measurement, Monitoring, and Program Evaluation

Budgeting for Financial Control, Management, and Planning

Developing Line-Item, Functional, and Program Budgeting Systems

Filters