Deck 19: Development and Application of Program Evaluation Research

Question 1

One example of the relevance of accountability was passage of the Government Performance and Results Modernization Act of ______.

A) 2001
B) 2004
C) 2009
D) 2010

Answer 1

D

Question 2

The standards for utility, according to Stufflebeam and Shinkfield (2007), concern ______.

A) whether the evaluation is reasonable to conduct
B) the extent to which an evaluation and its results are legally and ethically conducted
C) whether the information gained addresses the needs of the identified audience
D) all of these are true

Answer 2

C

Question 3

Feasibility standards address ______.

A) whether the evaluation is reasonable to conduct
B) the extent to which an evaluation and its results are legally and ethically conducted
C) whether the information gained addresses the needs of the identified audience
D) the extent to which the information and data collected accurately reflect the program being assessed or evaluated

Answer 3

A

Question 4

The propriety standard concerns ______.

A) whether the evaluation is reasonable to conduct
B) the extent to which an evaluation and its results are legally and ethically conducted
C) whether the information gained addresses the needs of the identified audience
D) none of these are true

Question 5

Accuracy is the standard that concerns ______.

A) whether the information gained addresses the needs of the identified audience
B) the extent to which an evaluation and its results are legally and ethically conducted
C) the extent to which the information and data collected accurately reflect the program being assessed or evaluated
D) the evaluation is reasonable to conduct

Question 6

______ concerns the use of appropriate evaluation methods and clear communication of the results to appropriate stakeholders.

A) Competence
B) Integrity/honesty
C) Systematic inquiry
D) Respect for people

Question 7

______ refers to ensuring the evaluation team has the appropriate credentials and skills to conduct the evaluation, and they have awareness of cultural issues that may impact an evaluation.

A) Competence
B) Integrity/honesty
C) Systematic inquiry
D) Respect for people

Question 8

Implementation of ______ principle in evaluation involves clearly disclosing conflicting relationships in roles regarding the evaluation and clearly stating the procedures used in the evaluation.

A) competence
B) integrity/honesty
C) systematic inquiry
D) respect for people

Question 9

______ principle includes communicating the importance of program participants and stakeholders in the evaluation process.

A) Competence
B) Integrity/honesty
C) Systematic inquiry
D) Respect for people

Question 10

______ principle involves ensuring a balance between a quality evaluation, sharing results with program stakeholders, and communicating the results to the general public as is appropriate.

A) Competence
B) Integrity/honesty
C) Systematic inquiry
D) Responsibilities for general and public

Question 11

Assessments designed to identify the discrepancy between actual conditions and what is sought or desired represent ______ type of evaluation.

A) formative
B) summative
C) need
D) outcome

Question 12

______ type of evaluation concerns whether a program is implemented as designed.

A) Formative
B) Summative
C) Need
D) Outcome

Question 13

______ results are typically provided to policy makers such as politicians.

A) Formative
B) Summative
C) Need
D) Outcome

Question 14

The use of checklists in evaluating programs is a key component of ______ model.

A) case study model
B) consumer-oriented model
C) product evaluation model
D) process evaluation model

Question 15

The use of an evaluation team provides more ______.

A) varied perspectives
B) objectivity
C) share of the volume of work
D) all of these

Question 16

Our society, including political and social institutions, has increasingly required more accountability in social service and educational programs.

Question 17

The standards from the Joint Committee on Standards for Educational Evaluation were first developed in the early 1950s.

Question 18

Evaluation results are generally given to those who are implementing the program.

Question 19

There are no systematic steps in conducting program evaluation as there are with scientific research.

Question 20

An insider, someone who works for the organization, may have a good understanding of the issues confronting an organization.

Question 21

Stakeholders are all those who may potentially be affected by the results of an evaluation.

Question 22

Stufflebeam's (2005) decision-making model uses case studies and interviews.

Question 23

It is not unusual for evaluators to develop an instrument that is specific to the program being evaluated--reliability and validity may therefore be compromised to some degree.

Question 24

For qualitative methods of evaluation, the researcher may also use methods of analysis similar to research approaches, such as using computer programs to analyze and search for common themes in interview transcripts.

Question 25

An evaluation report will usually look similar to a journal article.

Question 26

List the four general categories that the 30 standards of the Joint Committee on Standards for Educational Evaluation fall into.

Question 27

List the five basic principles of The Guiding Principles of Evaluators.

Question 28

List the three major types of evaluation.

Question 29

Give an example of a needs assessment.

Question 30

List the steps in conducting a program evaluation.

Question 31

Provide an example of a stakeholder.

Question 32

List two of the models of evaluation.

Question 33

What are a few methods to reduce problems with reliability and validity when developing an instrument for program evaluation?

Question 34

Briefly describe the CIPP evaluation model.

Question 35

Discuss the similarities and differences between research and program evaluation put forth by Gall et al. (2006).

Question 36

Compare and contrast the standards for utility, feasibility, propriety, and accuracy.

Question 37

Discuss the case study model of evaluation. Provide an example of when you would use this type of evaluation.

Question 38

Discuss the consumer-oriented approach to evaluation. Provide an example of when you would use this type of evaluation.

Question 39

What is typically included in an evaluation report?