Question 1

Correlating the amount of service received with the condition of the participants after receiving services from a program

Accepted Answer

A)  can sometimes suggest that a service is not effective. 
B)  cannot be useful if internal validity is low. 
C)  simply requires correlating a change score with a measure of service. 
D)  is more valid in isolating causes than a true experiment. 
A)  can sometimes suggest that a service is not effective. 
B)  cannot be useful if internal validity is low. 
C)  simply requires correlating a change score with a measure of service. 
D)  is more valid in isolating causes than a true experiment.

Question 2

If an evaluator judges the rate of success of a program on the basis of those who complete the program, she is likely to be failing to deal with the threat to internal validity called

Accepted Answer

A)  attrition. 
B)  regression to the mean. 
C)  testing. 
D)  history. 
A)  attrition. 
B)  regression to the mean. 
C)  testing. 
D)  history.

Question 3

Conclusion validity refers to

Accepted Answer

A)  statistical significance. 
B)  high internal validity. 
C)  high external validity. 
D)  adequate clinical power. 
A)  statistical significance. 
B)  high internal validity. 
C)  high external validity. 
D)  adequate clinical power.

Question 4

The difference between the mean of the outcome variable after a program and the mean of the variable measured before the program divided by the standard deviation of the pre-program scores is an index of

Accepted Answer

A)  effect size. 
B)  correlation. 
C)  statistical significance. 
D)  generalization. 
A)  effect size. 
B)  correlation. 
C)  statistical significance. 
D)  generalization.

Question 5

Regression to the mean is a threat to the internal validity of the pretest/posttest design whenever

Accepted Answer

A)  a long time transpires between the two observation periods. 
B)  program participants get older between the two observations. 
C)  people are chosen for a program because initial observations showed that they needed the program more than others did. 
D)  evaluators gain experience making the observations for the pretest and the posttest. 
A)  a long time transpires between the two observation periods. 
B)  program participants get older between the two observations. 
C)  people are chosen for a program because initial observations showed that they needed the program more than others did. 
D)  evaluators gain experience making the observations for the pretest and the posttest.

Question 6

Local history is a form of threat to internal validity referring to

Accepted Answer

A)  predictable changes in people that can be expected solely due to the passage of time. 
B)  events happening in the community that will change the behavior of the program participants. 
C)  events that are unique to a particular program group. 
D)  the changing nature of an evolving program. 
A)  predictable changes in people that can be expected solely due to the passage of time. 
B)  events happening in the community that will change the behavior of the program participants. 
C)  events that are unique to a particular program group. 
D)  the changing nature of an evolving program.

Question 7

The threat to internal validity (called "maturation") refers to

Accepted Answer

A)  predictable changes in people that can be expected solely due to the passage of time. 
B)  events happening in the community that will change the behavior of the program participants. 
C)  the improved skill of a program staff as they become more experienced. 
D)  differences between people who want a program and those who do not want it. 
A)  predictable changes in people that can be expected solely due to the passage of time. 
B)  events happening in the community that will change the behavior of the program participants. 
C)  the improved skill of a program staff as they become more experienced. 
D)  differences between people who want a program and those who do not want it.

Correlating the amount of service received with the condition of the participants after receiving services from a program

If an evaluator judges the rate of success of a program on the basis of those who complete the program, she is likely to be failing to deal with the threat to internal validity called

Conclusion validity refers to

The difference between the mean of the outcome variable after a program and the mean of the variable measured before the program divided by the standard deviation of the pre-program scores is an index of

Regression to the mean is a threat to the internal validity of the pretest/posttest design whenever

Local history is a form of threat to internal validity referring to

The threat to internal validity (called "maturation") refers to

Program Evaluation : an Overview

Planning an Evaluation

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Qualitative Evaluation Methods

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters

Exam 9: Outcome Evaluations With One Group

Correlating the amount of service received with the condition of the participants after receiving services from a program

If an evaluator judges the rate of success of a program on the basis of those who complete the program, she is likely to be failing to deal with the threat to internal validity called

Conclusion validity refers to

The difference between the mean of the outcome variable after a program and the mean of the variable measured before the program divided by the standard deviation of the pre-program scores is an index of

Regression to the mean is a threat to the internal validity of the pretest/posttest design whenever

Local history is a form of threat to internal validity referring to

The threat to internal validity (called "maturation") refers to

Program Evaluation : an Overview

Planning an Evaluation

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Qualitative Evaluation Methods

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters