Question 1

Qualitative evaluators defend their style of conducting evaluations by pointing out that evaluators who use only quantitative methods

Accepted Answer

A)  often are influenced by subjective expectations in the choice of issues to address and variables to measure. 
B)  seldom have complete control over threats to internal validity. 
C)  have never carried out a useful evaluation. 
D)  both a and b 
A)  often are influenced by subjective expectations in the choice of issues to address and variables to measure. 
B)  seldom have complete control over threats to internal validity. 
C)  have never carried out a useful evaluation. 
D)  both a and b D

Question 2

When qualitative data gatherers are present in a program setting but do not have a role in the interaction, they are called ______ observers.

Accepted Answer

A)  participant 
B)  pseudo-participant 
C)  non-participant 
D)  pseudo-staff members 
A)  participant 
B)  pseudo-participant 
C)  non-participant 
D)  pseudo-staff members C

Question 3

Physical artifacts of programs are called

Accepted Answer

A)  silent witnesses. 
B)  traces. 
C)  accretions. 
D)  deposits. 
A)  silent witnesses. 
B)  traces. 
C)  accretions. 
D)  deposits. B

Question 4

The Appreciative Inquiry strategy begins by learning what staff members believe

Accepted Answer

A)  needs the most improvement. 
B)  are the most controversial aspects of a program. 
C)  are the directions that they most want the program to begin. 
D)  are the aspects of the program that work particularly well. 
A)  needs the most improvement. 
B)  are the most controversial aspects of a program. 
C)  are the directions that they most want the program to begin. 
D)  are the aspects of the program that work particularly well.

Question 5

Even the most seasoned evaluators favoring quantitative methods recognize that evaluation design cannot plan for

Accepted Answer

A)  the successful achievement of program goals. 
B)  expected negative side-effects. 
C)  failure to meet program goals. 
D)  unexpected negative side effects. 
A)  the successful achievement of program goals. 
B)  expected negative side-effects. 
C)  failure to meet program goals. 
D)  unexpected negative side effects.

Question 6

Qualitative evaluators share their interpretations of program activities with the staff and other stakeholders as a

Accepted Answer

A)  good public relations practice. 
B)  check on subjectivity and to correct misunderstandings. 
C)  way to verify that observers do have access to all program activities. 
D)  method of gaining insights into statistical analyses. 
A)  good public relations practice. 
B)  check on subjectivity and to correct misunderstandings. 
C)  way to verify that observers do have access to all program activities. 
D)  method of gaining insights into statistical analyses.

Question 7

Describe the characteristics of program settings in which qualitative evaluations are probably more appropriate than quantitative evaluations.

Accepted Answer

Qualitative evaluations are probably mor

Question 8

If the entity being evaluated is a single unit with complex, multifaceted goals,

Accepted Answer

A)  it is hard to imagine how to do an experiment. 
B)  evaluators should insist that the program be simplified. 
C)  there is no valid way of conducting an evaluation. 
D)  a qualitative evaluation should be ruled out. 
A)  it is hard to imagine how to do an experiment. 
B)  evaluators should insist that the program be simplified. 
C)  there is no valid way of conducting an evaluation. 
D)  a qualitative evaluation should be ruled out.

Question 9

The settings in which the use of participant observers is most likely to be necessary to make direct observations are those that are

Accepted Answer

A)  relatively private. 
B)  do not involve a defensive program staff. 
C)  highly complex. 
D)  relatively public. 
A)  relatively private. 
B)  do not involve a defensive program staff. 
C)  highly complex. 
D)  relatively public.

Question 10

Which steps (that is, need assessment, implementation, outcome, cost analyses) in a program evaluation are most appropriately examined in a qualitative fashion?

Accepted Answer

The steps in a program evaluation that a

Question 11

When a program has vague or diffuse goals, evaluators

Accepted Answer

A)  may want to refuse to conduct an evaluation. 
B)  may decide to do a qualitative evaluation. 
C)  should seek to pin the staff down to something specific even if it doesn't reflect the richness of the program. 
D)  suspect that the staff members really don't know what they are trying to achieve. 
A)  may want to refuse to conduct an evaluation. 
B)  may decide to do a qualitative evaluation. 
C)  should seek to pin the staff down to something specific even if it doesn't reflect the richness of the program. 
D)  suspect that the staff members really don't know what they are trying to achieve.

Question 12

When interviewing for a qualitative evaluation, it is best to ask questions that

Accepted Answer

A)  demand a "yes/no" answer similar to questions in court cross-examinations. 
B)  can serve to make the best argument for the success of the program. 
C)  encourage the respondent to elaborate his/her own views about the topic of the question. 
D)  are readily coded numerically and subsequently analyzed statistically. 
A)  demand a "yes/no" answer similar to questions in court cross-examinations. 
B)  can serve to make the best argument for the success of the program. 
C)  encourage the respondent to elaborate his/her own views about the topic of the question. 
D)  are readily coded numerically and subsequently analyzed statistically.

Question 13

When a carefully done evaluation takes a long time to complete,

Accepted Answer

A)  stakeholders become more and more eager to get the results. 
B)  some stakeholders may no longer be interested in the issue. 
C)  it is probably best to refrain from giving progress reports because political forces will distort them. 
D)  it is probably correct to conclude that it was done poorly. 
A)  stakeholders become more and more eager to get the results. 
B)  some stakeholders may no longer be interested in the issue. 
C)  it is probably best to refrain from giving progress reports because political forces will distort them. 
D)  it is probably correct to conclude that it was done poorly.

Question 14

Qualitative evaluation procedures are particularly appropriate when

Accepted Answer

A)  the stakeholders can define clear, objective outcome goals. 
B)  there are ample opportunities to randomly assign program participants to groups. 
C)  stakeholders cannot wait until the program is over to evaluate the program. 
D)  when there are many groups of participants getting identical services (e.g. medicines). 
A)  the stakeholders can define clear, objective outcome goals. 
B)  there are ample opportunities to randomly assign program participants to groups. 
C)  stakeholders cannot wait until the program is over to evaluate the program. 
D)  when there are many groups of participants getting identical services (e.g. medicines).

Question 15

Qualitative evaluation methods are especially sensitive to

Accepted Answer

A)  the unique features of the organizational setting of the program to be evaluated. 
B)  the test/retest reliability of the measures used. 
C)  the advantages of matching groups using standardized tests. 
D)  statistical analyses using large samples. 
A)  the unique features of the organizational setting of the program to be evaluated. 
B)  the test/retest reliability of the measures used. 
C)  the advantages of matching groups using standardized tests. 
D)  statistical analyses using large samples.

Question 16

Stakeholder concerns and the empowerment of less powerful stakeholders is central for the _________ evaluator.

Accepted Answer

A)  quantitative 
B)  external 
C)  qualitative 
D)  internal 
A)  quantitative 
B)  external 
C)  qualitative 
D)  internal

Question 17

The first phase of a qualitative evaluation requires that an evaluator

Accepted Answer

A)  draw up mock tables to be used to present the data to be gathered. 
B)  develop a set of questions with a definite order. 
C)  share openly his/her interpretations with the program staff. 
D)  make unrestricted observations. 
A)  draw up mock tables to be used to present the data to be gathered. 
B)  develop a set of questions with a definite order. 
C)  share openly his/her interpretations with the program staff. 
D)  make unrestricted observations.

Question 18

A crucial difference between qualitative and quantitative evaluations is the central importance of _______ in qualitative evaluations.

Accepted Answer

A)  complex statistical analyses 
B)  objective assessment 
C)  automated data collection 
D)  the observations of the data gatherer 
A)  complex statistical analyses 
B)  objective assessment 
C)  automated data collection 
D)  the observations of the data gatherer

Question 19

The Success Case Method focuses on those participants who were most successful in order to

Accepted Answer

A)  provide a favorable evaluation. 
B)  win over cynical stakeholders. 
C)  shame unsuccessful participants into better behaviors. 
D)  identify behaviors and program experiences that are associated with success. 
A)  provide a favorable evaluation. 
B)  win over cynical stakeholders. 
C)  shame unsuccessful participants into better behaviors. 
D)  identify behaviors and program experiences that are associated with success.

Question 20

Compare the potential for threat to program staff members from a qualitative evaluation versus program monitoring standpoint.

Accepted Answer

From a qualitative evaluation standpoint

Qualitative evaluators defend their style of conducting evaluations by pointing out that evaluators who use only quantitative methods

When qualitative data gatherers are present in a program setting but do not have a role in the interaction, they are called ______ observers.

Physical artifacts of programs are called

The Appreciative Inquiry strategy begins by learning what staff members believe

Even the most seasoned evaluators favoring quantitative methods recognize that evaluation design cannot plan for

Qualitative evaluators share their interpretations of program activities with the staff and other stakeholders as a

Describe the characteristics of program settings in which qualitative evaluations are probably more appropriate than quantitative evaluations.

If the entity being evaluated is a single unit with complex, multifaceted goals,

The settings in which the use of participant observers is most likely to be necessary to make direct observations are those that are

Which steps (that is, need assessment, implementation, outcome, cost analyses) in a program evaluation are most appropriately examined in a qualitative fashion?

When a program has vague or diffuse goals, evaluators

When interviewing for a qualitative evaluation, it is best to ask questions that

When a carefully done evaluation takes a long time to complete,

Qualitative evaluation procedures are particularly appropriate when

Qualitative evaluation methods are especially sensitive to

Stakeholder concerns and the empowerment of less powerful stakeholders is central for the _________ evaluator.

The first phase of a qualitative evaluation requires that an evaluator

A crucial difference between qualitative and quantitative evaluations is the central importance of _______ in qualitative evaluations.

The Success Case Method focuses on those participants who were most successful in order to

Compare the potential for threat to program staff members from a qualitative evaluation versus program monitoring standpoint.

Program Evaluation : an Overview

Planning an Evaluation

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Outcome Evaluations With One Group

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters

Exam 8: Qualitative Evaluation Methods

Qualitative evaluators defend their style of conducting evaluations by pointing out that evaluators who use only quantitative methods

When qualitative data gatherers are present in a program setting but do not have a role in the interaction, they are called ______ observers.

Physical artifacts of programs are called

The Appreciative Inquiry strategy begins by learning what staff members believe

Even the most seasoned evaluators favoring quantitative methods recognize that evaluation design cannot plan for

Qualitative evaluators share their interpretations of program activities with the staff and other stakeholders as a

Describe the characteristics of program settings in which qualitative evaluations are probably more appropriate than quantitative evaluations.

If the entity being evaluated is a single unit with complex, multifaceted goals,

The settings in which the use of participant observers is most likely to be necessary to make direct observations are those that are

Which steps (that is, need assessment, implementation, outcome, cost analyses) in a program evaluation are most appropriately examined in a qualitative fashion?

When a program has vague or diffuse goals, evaluators

When interviewing for a qualitative evaluation, it is best to ask questions that

When a carefully done evaluation takes a long time to complete,

Qualitative evaluation procedures are particularly appropriate when

Qualitative evaluation methods are especially sensitive to

Stakeholder concerns and the empowerment of less powerful stakeholders is central for the _________ evaluator.

The first phase of a qualitative evaluation requires that an evaluator

A crucial difference between qualitative and quantitative evaluations is the central importance of _______ in qualitative evaluations.

The Success Case Method focuses on those participants who were most successful in order to

Compare the potential for threat to program staff members from a qualitative evaluation versus program monitoring standpoint.

Program Evaluation : an Overview

Planning an Evaluation

Developing and Using a Theory of the Program

Developing Measures of Implementation and Outcomes

Ethics in Program Evaluation

The Assessment of Need

Monitoring the Implementation and the Operation of Programs

Outcome Evaluations With One Group

Quasi-Experimental Approaches to Outcome Evaluation

Using Experiments to Evaluate Programs

Analyses of Costs and Outcomes

Evaluation Reports: Interpreting and Communicating Findings

How to Encourage Utilization

Filters