Deck 1: Program Evaluation : an Overview

Question 1

One of the major failings in the development and implementation of social service programs is

A) beginning the service without first demonstrating the effectiveness of the service.
B) spending too much effort identifying the needs of the population.
C) saddling the service program with too many requirements to demonstrate its effectiveness.
D) isolating the service program from the political structure of the area needing the service.

Answer 1

A

Question 2

The effectiveness of social services has often not been evaluated because

A) the values of all such services are already well documented.
B) the desired outcomes are indeed hard to measure.
C) it is usually sufficient to merely show interest in helping.
D) government regulations forbid evaluations of human services.

Answer 2

B

Question 3

Evaluators have often

A) ignored existing measures of the outcomes of services.
B) failed to contact the managers of programs.
C) used large samples with low Type II errors.
D) overlooked possible negative side effects of programs.

Answer 3

D

Question 4

Program evaluation gets confused with basic research when evaluators

A) focus on the needs of the program sponsor.
B) become advocates for the program participants.
C) ignore practical issues in order to examine theoretical questions.
D) use variables suggested by the staff of service programs.

Question 5

An evaluation of need refers to evaluations that

A) are similar to performance appraisals.
B) isolate the costs of providing various services.
C) are particularly useful in planning a new program.
D) violate fundamental scientific standards.

Question 6

Evaluations of process often focus on the degree to which

A) a program is successful.
B) a specific service is needed in a community.
C) the costs required to run a program can be justified.
D) the program is implemented as planned.

Question 7

Outcome evaluations provide the data to show whether

A) a service has achieved appropriate results.
B) a target population will use a service.
C) the evaluator has made every effort to work with the program director in an effective manner.
D) resources were spent on programs that are most needed.

Question 8

When an evaluation relates the cost of a program to its outcomes, this form of evaluation can be thought of as

A) an evaluation of performance.
B) an evaluation of efficiency.
C) a variant of basic research.
D) overly scientific.

Question 9

Formative evaluation is to summative evaluation as

A) process is to outcome.
B) constructive criticism is to final grades.
C) apples are to apple pies.
D) cancellation is to initiation.

Question 10

The purpose of a formative evaluation is to provide information to program sponsors

A) making decisions about maintaining or terminating the program.
B) to minimize the effects of arbitrary federal requirements for program evaluations.
C) making program improvements.
D) for public relations needs.

Question 11

It is sometimes hard to learn who is conducting program evaluations in an organization because

A) few organizations really need to have their services evaluated.
B) formal evaluations are conducted by most managers of service programs.
C) the job titles of evaluators are not standardized.
D) when evaluations are completed, they usually look like basic research.

Question 12

If the management of an organization plans to maintain or eliminate a service on the basis of its documented degree of effectiveness, then a

A) summative evaluation is needed.
B) needs analysis should be conducted.
C) formative evaluation is needed.
D) person familiar with the program should conduct an evaluation.

Question 13

The strongest advantage that an external evaluator has over an internal evaluator is

A) the trust he/she has built up over years.
B) more well-developed analytic skills.
C) the potential to be more objective.
D) the influence to see that the findings are used by the program staff.

Question 14

The four major forms of program evaluation are

A) internal, external, conclusion, and construct.
B) performance, institutional, accountability, and program review.
C) need, process, outcome, and efficiency.
D) community, governmental, professional, and special interest.

Question 15

A process evaluation would probably NOT include which one of the following questions?

A) Do the program's actual participants represent the target population?
B) How much staff-client contact really occurs?
C) Do actual staff activities match the program plan?
D) Is the program cost-effective?

Question 16

Internal program evaluators usually have which following advantage over consultant evaluators?

A) better statistical and research competence
B) better support staff
C) a more objective approach to the program
D) more complete knowledge of the organization sponsoring the program

Question 17

Program evaluation is frequently confused with

A) billing and accounting procedures.
B) basic research and individual assessment.
C) therapist's progress notes.
D) crisis management methodology.

Question 18

The ultimate purposes of program evaluation include

A) the collection of data on the outcome of services.
B) an assessment of how program staff people spend their time so that ineffective staff members can be identified.
C) making decisions about the proper groups a program should serve.
D) the improvement of implemented programs and the wise selection among possible programs.

Question 19

Monitoring is a form of evaluation which focuses on

A) providing definitive proof that a program is worth the investment.
B) being sure that data are available to make refinements in a program.
C) providing frequent feedback to be sure a program stays on track.
D) financial resources so that funds are not misspent.

Question 20

Implementation of programs should be examined because

A) fraud is rampant in social programs.
B) irresponsible service providers often destroy programs.
C) internal evaluators usually ignore this issue.
D) programs are less effective when not offered at full strength.

Question 21

In parallel columns, list the advantages and disadvantages of internal and external evaluators.

Question 22

Outline the essential questions that evaluators seek to answer.

Question 23

To what degree is it true that people seek to evaluate their own efforts?

Question 24

Why is it more complicated to evaluate organized programs than the effort of an individual?

Question 25

Make a list of college (or community) services that you use which you believe could be improved if evaluated carefully. Pick one and explain why it is in particular need of evaluation.