Deck 16: Using Research Methods for Continuous Improvement

Question 1

The two types of classification of evaluation - those focused on the role of the evaluation and those focused on the process of the evaluation are _________________________.

A) mutually exclusive
B) not mutually exclusive
C) concrete and restricted
D) absolute

Answer 1

B

Question 2

_____________________ is a systematic way to demonstrate to stakeholders what progress has been made in regard to intended outcomes.

A) general sentiment
B) academic reporting
C) testimonials
D) program evaluation

Answer 2

D

Question 3

______________________ tends to be an ongoing effort focused on some aspect of general organizational performance.

A) performance measurement
B) performance evaluation
C) program measurement
D) program evaluation

Answer 3

A

Question 4

__________________________ tends to be more episodic and issue specific.

A) performance evaluation
B) program measurement
C) program evaluation
D) performance measurement

Question 5

Process evaluation and outcome evaluation are both centered on the ___________________ of the evaluation rather than the role.

A) focus
B) formation
C) summative
D) measurement

Question 6

A ______________________ is typically conducted as part of a formative evaluation in order to identify the essentials for a program among the target population.

A) performance evaluation
B) needs assessment
C) cost-effectiveness analysis
D) cost-benefit analysis

Question 7

A ________________________ considers the cost and the value produced by a program in financial terms.

A) performance evaluation
B) needs assessment
C) cost-effectiveness analysis
D) cost-benefit analysis

Question 8

In a _______________________ the potential outcomes of a program are captured in both financial and nonfinancial terms.

A) performance evaluation
B) needs assessment
C) cost-effectiveness analysis
D) cost-benefit analysis

Question 9

_________________________ is intended to provide decision makers with information on what to do with a program.

A) outcome evaluation
B) formative evaluation
C) process evaluation
D) summative evaluation

Question 10

Since "good evaluations use scientific methods" practitioners who are conducting program evaluations should have, at least, an understanding of _____________________.

A) advanced statistical techniques
B) complex regression equations
C) basic research approaches
D) cutting-edge research philosophy

Question 11

____________________ is focused on assessing how well a clearly identifiable program is working.

A) performance measurement
B) program evaluation
C) program measurement
D) performance evaluation
True/False

Question 12

If Mary decides that she would like to track what brings volunteers to Health First on an ongoing basis she will more closely being performing what type of study?

A) performance measurement
B) program evaluation
C) program measurement
D) performance evaluation

Question 13

NPM stands for which influential movement in the realm of program evaluation?

A) non-profit management
B) non-profit measurement
C) new public management
D) new public measurement

Question 14

____________________ is intended to provide decision makers with information on what to do with a program.

A) process evaluation
B) formative evaluation
C) process evaluation
D) summative evaluation

Question 15

If in the pilot phase of the alternative service delivery model, Jim evaluates the outcome of the alternative model based on cost and mortality rate, it most closely fits what classifications of evaluation?

A) process-formative
B) process-summative
C) outcome-formative
D) outcome-summative

Question 16

A systemic inquiry and competent evaluators are important ____________________ considerations according to the American Evaluation Association.

A) responsible
B) ethical
C) research
D) analytical

Question 17

__________________________ is regular monitoring and reporting of particular organizational operations that may or may not be associated with a program.

A) performance measurement
B) program evaluation
C) program measurement
D) performance evaluation

Question 18

________________________ and _________________________ evaluations are both focused on the role of the evaluation.

A) formative; process
B) formative; outcome
C) formative; summative
D) summative; process

Question 19

A __________________ is intended to improve the program implementation process.

A) performance measurement
B) formative evaluation
C) summative evaluation
D) process evaluation

Question 20

________________________ is focuses on whether the program had a demonstrated effect and produced intended outcomes.

A) outcome evaluation
B) formative evaluation
C) process evaluation
D) summative evaluation

Question 21

The lines between classifying a project an evaluation or as a measurement are sometimes unclear.

Question 22

A summative evaluation asks questions like, "what's happening and why?"

Question 23

The NPM movement focuses on improving the efficiency of public-sector organizations by measuring and rewarding performance.

Question 24

What are the fundamental differences between program evaluation and performance measurement?

Question 25

A formative evaluation is typically performed after a program is well-established.

Question 26

"Can the operation be improved?" is a question applicable to performance measurement.

Question 27

If Jim asks the firefighters and paramedics how they think the process of the alternative service delivery model can be improved during the pilot process, the evaluation is both a process evaluation and a formative evaluation.

Question 28

An outcome evaluation is typically concerned with the survival of a program based on the bottom line.

Question 29

How would you describe the evaluation process of Emily? Would you recommend her making any additional efforts?

Question 30

A program is considered a group of related activities that are intended to achieve one or several objectives.

Question 31

The second step of a needs assessment is to examine which services are available.

Question 32

A cost-benefit and cost-effectiveness analysis should only be conducted at the beginning of the program.

Question 33

What are the different approaches to program evaluation? What approaches would you recommend for Emily, Mary, and Jim?