Question 1

A major failing of many evaluations is that the evaluator never learned

Accepted Answer

A)  what the outcome measures were. 
B)  why the program activities were expected to lead to the desired outcomes. 
C)  who was to receive the report and use the findings. 
D)  how the analysis was done or what the statistical findings were. 
A)  what the outcome measures were. 
B)  why the program activities were expected to lead to the desired outcomes. 
C)  who was to receive the report and use the findings. 
D)  how the analysis was done or what the statistical findings were. B

Question 2

Using expert opinion as a form of program evaluation is especially useful when *

Accepted Answer

A)  the program is complex and there are few clear objective criteria of effectiveness. 
B)  there are readily observable outcomes from a program. 
C)  it is essential that the causal connection between the program and the outcome be definitely understood. 
D)  new medications are being evaluated. 
A)  the program is complex and there are few clear objective criteria of effectiveness. 
B)  there are readily observable outcomes from a program. 
C)  it is essential that the causal connection between the program and the outcome be definitely understood. 
D)  new medications are being evaluated. A

Question 3

What can evaluators do to encourage stakeholders to take additional responsibility for programs in which they are involved?

Accepted Answer

Evaluators can play a crucial role in encouraging stakeholders to take additional responsibility for programs by implementing several strategies that foster engagement, ownership, and accountability. Here are some approaches evaluators can use:

1. **Inclusive Planning**: Involve stakeholders from the beginning in the planning and design of the evaluation. This helps ensure that the evaluation addresses their needs and concerns, and it can increase their commitment to the program.

2. **Clear Communication**: Maintain open and transparent communication with stakeholders about the goals, processes, and outcomes of the evaluation. This helps build trust and understanding, which are essential for stakeholders to feel responsible for the program's success.

3. **Capacity Building**: Provide stakeholders with the necessary training and resources to understand and participate in the evaluation process. This empowers them to take on more responsibility and make informed decisions about the program.

4. **Collaborative Goal Setting**: Work with stakeholders to set realistic and achievable goals for the program. When stakeholders are involved in goal setting, they are more likely to feel a sense of ownership and responsibility for meeting those goals.

5. **Feedback Mechanisms**: Establish regular feedback loops where stakeholders can share their insights and concerns about the program. This not only provides valuable information for the evaluation but also reinforces stakeholders' roles as active contributors.

6. **Recognition of Contributions**: Acknowledge and celebrate the contributions of stakeholders. Recognizing their efforts can motivate them to continue being involved and taking responsibility.

7. **Shared Decision-Making**: Encourage a participatory approach where stakeholders have a say in decision-making processes. When stakeholders are part of the decision-making, they are more likely to feel accountable for the outcomes.

8. **Sustainability Planning**: Work with stakeholders to develop a plan for sustaining the program beyond the evaluation period. This helps stakeholders envision their long-term role and the importance of their continued involvement.

9. **Utilization-Focused Evaluation**: Design the evaluation with a focus on how the findings will be used by stakeholders. When stakeholders see the practical value of the evaluation, they are more likely to take ownership of implementing recommendations.

10. **Fostering a Culture of Learning**: Promote a culture where learning from the evaluation is valued. When stakeholders see the program as a learning opportunity, they are more likely to engage deeply and take responsibility for continuous improvement.

By implementing these strategies, evaluators can help create an environment where stakeholders feel empowered, valued, and responsible for the success of the programs in which they are involved. This not only enhances the effectiveness of the program but also ensures that the benefits of the evaluation are maximized for all parties involved.

Question 4

One way to reduce fear and resistance to evaluation activities is to reassure staff that

Accepted Answer

A)  the larger community will be better off knowing when a program is ineffective. 
B)  program participants (i.e. the clients) have a right to know how effective the program is. 
C)  documenting success would increase the organization's commitment to the program. 
D)  less that half of outcome evaluations result in the curtailment of a program. 
A)  the larger community will be better off knowing when a program is ineffective. 
B)  program participants (i.e. the clients) have a right to know how effective the program is. 
C)  documenting success would increase the organization's commitment to the program. 
D)  less that half of outcome evaluations result in the curtailment of a program.

Question 5

Goal-free evaluation refers to evaluations that are conducted

Accepted Answer

A)  on programs with no goals. 
B)  when program managers cannot describe their goals. 
C)  when the program is designed to show that the government is "doing something" but no one expects improved outcomes. 
D)  when evaluators want to examine the program without their own expectations being affected by knowledge of the program's goals. 
A)  on programs with no goals. 
B)  when program managers cannot describe their goals. 
C)  when the program is designed to show that the government is "doing something" but no one expects improved outcomes. 
D)  when evaluators want to examine the program without their own expectations being affected by knowledge of the program's goals.

Question 6

Understanding the conceptual foundation of a program provides an evaluator with

Accepted Answer

A)  hints about how the program services are expected to lead to the outcomes that the staff and director hope to achieve. 
B)  some indication of how much impact the evaluation will actually have on the organization sponsoring the program. 
C)  some indication that the evaluation will really have an effect on the people who need the services of the program being evaluated. 
D)  the expected conflicts between the evaluator and the management that may well impact the quality of the project. 
A)  hints about how the program services are expected to lead to the outcomes that the staff and director hope to achieve. 
B)  some indication of how much impact the evaluation will actually have on the organization sponsoring the program. 
C)  some indication that the evaluation will really have an effect on the people who need the services of the program being evaluated. 
D)  the expected conflicts between the evaluator and the management that may well impact the quality of the project.

Question 7

A skill that is more important in program evaluation compared to basic social science research is

Accepted Answer

A)  estimating accurately how much time each phase of the project will require. 
B)  being able to plan valid research designs. 
C)  selecting measures of behavior that are reliable. 
D)  molding the project to answer questions relevant to social theories. 
A)  estimating accurately how much time each phase of the project will require. 
B)  being able to plan valid research designs. 
C)  selecting measures of behavior that are reliable. 
D)  molding the project to answer questions relevant to social theories.

Question 8

"Evaluability assessment" refers to the

Accepted Answer

A)  ability of the program managers to fund an evaluator. 
B)  knowing how to carry out statistical analyses. 
C)  reliability of the measures of program outcome that are chosen. 
D)  likelihood that a valid evaluation can be completed. 
A)  ability of the program managers to fund an evaluator. 
B)  knowing how to carry out statistical analyses. 
C)  reliability of the measures of program outcome that are chosen. 
D)  likelihood that a valid evaluation can be completed.

Question 9

An evaluation of high quality usually __________ than one of lower quality.

Accepted Answer

A)  is based on data from a greater number of program participants 
B)  was designed with input from fewer stakeholder groups 
C)  is based on data from a more representative sample of program participants 
D)  employs less costly surveys and questionnaires 
A)  is based on data from a greater number of program participants 
B)  was designed with input from fewer stakeholder groups 
C)  is based on data from a more representative sample of program participants 
D)  employs less costly surveys and questionnaires

Question 10

Describe how one would discuss random assignment to treatment or non-treatment conditions with a group of people who applied for a new oversubscribed job-training program.

Accepted Answer

When discussing random assignment to tre

Question 11

Program evaluation, like other types of applied social science research, differs from basic research in that

Accepted Answer

A)  validity is irrelevant in applied research although reliability is critical to both. 
B)  reliable measurement is irrelevant in applied research. 
C)  there are definite time limits for completing applied research projects. 
D)  program participants cannot refuse to provide data. 
A)  validity is irrelevant in applied research although reliability is critical to both. 
B)  reliable measurement is irrelevant in applied research. 
C)  there are definite time limits for completing applied research projects. 
D)  program participants cannot refuse to provide data.

Question 12

The first step in planning an evaluation is to

Accepted Answer

A)  suggest outcome measurement instruments to the staff. 
B)  identify the stakeholders of the evaluation. 
C)  try to figure out how the evaluation could be done as an experiment. 
D)  caution the program director that the evaluation will be tough. 
A)  suggest outcome measurement instruments to the staff. 
B)  identify the stakeholders of the evaluation. 
C)  try to figure out how the evaluation could be done as an experiment. 
D)  caution the program director that the evaluation will be tough.

Question 13

How would the difference between formative and summative evaluations affect the negotiations with program staff and other stakeholders in the planning of an evaluation?

Accepted Answer

The difference between formative and sum

Question 14

A written proposal outlining the steps to be followed in carrying out a planned program evaluation

Accepted Answer

A)  should always be prepared. 
B)  can be omitted if the evaluation is conducted internally. 
C)  should always bind the evaluator to exactly the procedures described. 
D)  cannot realistically be prepared since so many unplanned events impinge upon program evaluations. 
A)  should always be prepared. 
B)  can be omitted if the evaluation is conducted internally. 
C)  should always bind the evaluator to exactly the procedures described. 
D)  cannot realistically be prepared since so many unplanned events impinge upon program evaluations.

Question 15

Considerable assistance can be obtained in planning a program evaluation from

Accepted Answer

A)  published evaluations. 
B)  the Internet. 
C)  informal conversations with other evaluators. 
D)  all of the above 
A)  published evaluations. 
B)  the Internet. 
C)  informal conversations with other evaluators. 
D)  all of the above

Question 16

One way for evaluators to mollify the critics of a program evaluation project is

Accepted Answer

A)  to demonstrate clear analytical skills. 
B)  to mold the project design to avoid any points of concern. 
C)  to listen to the worries of the critics and relieve all concerns that are founded on misperceptions of program evaluation. 
D)  for the evaluator to ally him/herself with the facility management, who will see to it that the correct procedures are followed. 
A)  to demonstrate clear analytical skills. 
B)  to mold the project design to avoid any points of concern. 
C)  to listen to the worries of the critics and relieve all concerns that are founded on misperceptions of program evaluation. 
D)  for the evaluator to ally him/herself with the facility management, who will see to it that the correct procedures are followed.

Question 17

An evaluation to focus on participants who have achieved the program goals

Accepted Answer

A)  is usually a good basis for a summative evaluation. 
B)  is inherently dishonest. 
C)  lies at the heart of the social science model. 
D)  is called the Success Case Method. 
A)  is usually a good basis for a summative evaluation. 
B)  is inherently dishonest. 
C)  lies at the heart of the social science model. 
D)  is called the Success Case Method.

Question 18

The data collection is

Accepted Answer

A)  best turned over to the program staff since they are on the scene and can easily handle the activity. 
B)  to be handled by someone without direct knowledge of the setting of the program since it is usually a rather mechanical process. 
C)  likely to be corrupted even by well-meaning program staff members if they are permitted to control data collection. 
D)  fairly simple since confidentiality is not an issue in applied social research projects. 
A)  best turned over to the program staff since they are on the scene and can easily handle the activity. 
B)  to be handled by someone without direct knowledge of the setting of the program since it is usually a rather mechanical process. 
C)  likely to be corrupted even by well-meaning program staff members if they are permitted to control data collection. 
D)  fairly simple since confidentiality is not an issue in applied social research projects.

Question 19

Resistance to an evaluation is likely to be greatest when the evaluation is

Accepted Answer

A)  a formative evaluation. 
B)  a cost-effectiveness evaluation. 
C)  an outcome evaluation. 
D)  a summative evaluation. 
A)  a formative evaluation. 
B)  a cost-effectiveness evaluation. 
C)  an outcome evaluation. 
D)  a summative evaluation.

Question 20

The social science model for program evaluation served to

Accepted Answer

A)  get rid of a lot of ineffective services. 
B)  demonstrate that a non-significant statistical test showed that the program was ineffective. 
C)  introduce more creativity into program evaluation methods. 
D)  introduce additional rigor into program evaluation practices. 
A)  get rid of a lot of ineffective services. 
B)  demonstrate that a non-significant statistical test showed that the program was ineffective. 
C)  introduce more creativity into program evaluation methods. 
D)  introduce additional rigor into program evaluation practices.

A major failing of many evaluations is that the evaluator never learned

Using expert opinion as a form of program evaluation is especially useful when *

What can evaluators do to encourage stakeholders to take additional responsibility for programs in which they are involved?

One way to reduce fear and resistance to evaluation activities is to reassure staff that

Goal-free evaluation refers to evaluations that are conducted

Understanding the conceptual foundation of a program provides an evaluator with

A skill that is more important in program evaluation compared to basic social science research is

"Evaluability assessment" refers to the

An evaluation of high quality usually __________ than one of lower quality.

Describe how one would discuss random assignment to treatment or non-treatment conditions with a group of people who applied for a new oversubscribed job-training program.

Program evaluation, like other types of applied social science research, differs from basic research in that

The first step in planning an evaluation is to

How would the difference between formative and summative evaluations affect the negotiations with program staff and other stakeholders in the planning of an evaluation?

A written proposal outlining the steps to be followed in carrying out a planned program evaluation

Considerable assistance can be obtained in planning a program evaluation from

One way for evaluators to mollify the critics of a program evaluation project is

An evaluation to focus on participants who have achieved the program goals

The data collection is

Resistance to an evaluation is likely to be greatest when the evaluation is

The social science model for program evaluation served to

Program Evaluation : an Overview

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Qualitative Evaluation Methods

Outcome Evaluations With One Group

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters

Exam 2: Planning an Evaluation

A major failing of many evaluations is that the evaluator never learned

Using expert opinion as a form of program evaluation is especially useful when *

What can evaluators do to encourage stakeholders to take additional responsibility for programs in which they are involved?

One way to reduce fear and resistance to evaluation activities is to reassure staff that

Goal-free evaluation refers to evaluations that are conducted

Understanding the conceptual foundation of a program provides an evaluator with

A skill that is more important in program evaluation compared to basic social science research is

"Evaluability assessment" refers to the

An evaluation of high quality usually __________ than one of lower quality.

Describe how one would discuss random assignment to treatment or non-treatment conditions with a group of people who applied for a new oversubscribed job-training program.

Program evaluation, like other types of applied social science research, differs from basic research in that

The first step in planning an evaluation is to

How would the difference between formative and summative evaluations affect the negotiations with program staff and other stakeholders in the planning of an evaluation?

A written proposal outlining the steps to be followed in carrying out a planned program evaluation

Considerable assistance can be obtained in planning a program evaluation from

One way for evaluators to mollify the critics of a program evaluation project is

An evaluation to focus on participants who have achieved the program goals

The data collection is

Resistance to an evaluation is likely to be greatest when the evaluation is

The social science model for program evaluation served to

Program Evaluation : an Overview

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Qualitative Evaluation Methods

Outcome Evaluations With One Group

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters