Question 1

Program implementation can fail for a number of reasons. These reasons include

Accepted Answer

A)  specific procedures for carrying out the program were not identified. 
B)  the program staff did not deliver the program as designed. 
C)  stakeholders who did not like the program resisted its implementation. 
D)  all of the above. 
A)  specific procedures for carrying out the program were not identified. 
B)  the program staff did not deliver the program as designed. 
C)  stakeholders who did not like the program resisted its implementation. 
D)  all of the above. D

Question 2

Professor Martinez wants to determine the degree of change experienced by the client population after a program has been implemented. He can do so by

Accepted Answer

A)  comparing the mean change in the client group to the mean change in a control group. 
B)  calculating an effect size as an indicator of the program's effectiveness. 
C)  averaging the amount of change experienced by each client. 
D)  doing any of the above 
A)  comparing the mean change in the client group to the mean change in a control group. 
B)  calculating an effect size as an indicator of the program's effectiveness. 
C)  averaging the amount of change experienced by each client. 
D)  doing any of the above D

Question 3

Which of the following statements about selectively enrolling clients in a program is TRUE?

Accepted Answer

A)  The internal validity of the program evaluation would be enhanced. 
B)  The generalizability of the program would be threatened. 
C)  The possibility that the entire target population is adequately served would be increased. 
D)  Any minor problems caused by selective enrollment could be ignored. 
A)  The internal validity of the program evaluation would be enhanced. 
B)  The generalizability of the program would be threatened. 
C)  The possibility that the entire target population is adequately served would be increased. 
D)  Any minor problems caused by selective enrollment could be ignored. B

Question 4

The reliability of a difference score INCREASES as

Accepted Answer

A)  the reliability of the measure for which difference scores are being assessed increases. 
B)  the correlation between the pretest scores on the measure and the difference scores increase. 
C)  the correlation between the pretest scores and the posttest scores approaches zero. 
D)  a function of all of the above. 
A)  the reliability of the measure for which difference scores are being assessed increases. 
B)  the correlation between the pretest scores on the measure and the difference scores increase. 
C)  the correlation between the pretest scores and the posttest scores approaches zero. 
D)  a function of all of the above.

Question 5

Identifying the client population of a program is important because

Accepted Answer

A)  a program's services can be offered to people who do not actually need it. 
B)  in the context of designing interventions, the client population is the problem to be addressed. 
C)  it is the only way to identify an appropriate theory. 
D)  the characteristics of the client population drive the entire evaluation processes. 
A)  a program's services can be offered to people who do not actually need it. 
B)  in the context of designing interventions, the client population is the problem to be addressed. 
C)  it is the only way to identify an appropriate theory. 
D)  the characteristics of the client population drive the entire evaluation processes.

Question 6

Name and define three criteria that increase the likelihood that the results of evaluation research will be used by decision makers.

Accepted Answer

Name and define three criteria that incr

Question 7

Dr. Char tells a policy maker about the results of his evaluation research because the findings can be used to address political attacks levied at a program. This is an example of ________ utilization of evaluation results.

Accepted Answer

A)  persuasive 
B)  conceptual 
C)  instrumental 
D)  relevance 
A)  persuasive 
B)  conceptual 
C)  instrumental 
D)  relevance

Question 8

What factors limit a researcher's ability to conduct a true experiment to assess the program's effectiveness?

Accepted Answer

Several factors can limit a researcher's

Question 9

Which of the following is a concern with using mean change as an indicator of a program's effectiveness?

Accepted Answer

A)  stakeholders often do not understand statistical analyses 
B)  an effect size cannot be computed from this type of data 
C)  a group average can obscure individual differences in response to the treatment 
D)  all of the above are concerns 
A)  stakeholders often do not understand statistical analyses 
B)  an effect size cannot be computed from this type of data 
C)  a group average can obscure individual differences in response to the treatment 
D)  all of the above are concerns

Question 10

In one version of a program, clients participate once a week. In another version, they participate twice a week. Which design would be used to compare the two programs?

Accepted Answer

A)  program package 
B)  formative 
C)  constructive 
D)  parametric 
A)  program package 
B)  formative 
C)  constructive 
D)  parametric

Question 11

_______ evaluation research addresses the needs of all stakeholders.

Accepted Answer

A)  Relevant 
B)  True 
C)  High utility 
D)  Cost-effective 
A)  Relevant 
B)  True 
C)  High utility 
D)  Cost-effective

Question 12

Dr. Bhalla wants to assess whether on-the-job training improves employee retention. Which of the following would be a summative assessment of the program's effectiveness?

Accepted Answer

A)  anonymously assessing employee satisfaction at the midpoint of the program 
B)  scores on a standardized achievement test given at the end of the program 
C)  assessing pre-training ability levels 
D)  all of the above 
A)  anonymously assessing employee satisfaction at the midpoint of the program 
B)  scores on a standardized achievement test given at the end of the program 
C)  assessing pre-training ability levels 
D)  all of the above

Question 13

Research on the effectiveness of implementing a program with a new client population is an example of the ________ evaluation research design.

Accepted Answer

A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric 
A)  comparative outcome 
B)  client and program variation 
C)  constructive 
D)  parametric

Question 14

To conduct a proper evaluation, researchers must know, among other things,

Accepted Answer

A)  the goals of the program. 
B)  the expected consequences of achieving the program's goals. 
C)  the size of the effect the program is expected to have. 
D)  all of the above. 
A)  the goals of the program. 
B)  the expected consequences of achieving the program's goals. 
C)  the size of the effect the program is expected to have. 
D)  all of the above.

Question 15

Including program theory in the evaluation of a program

Accepted Answer

A)  helps evaluators assess whether the conditions necessary for program success are met. 
B)  allows researchers to identify the most important program components. 
C)  provides evaluators with possible reasons for why a program did not meet its objectives. 
D)  does all of the above. 
A)  helps evaluators assess whether the conditions necessary for program success are met. 
B)  allows researchers to identify the most important program components. 
C)  provides evaluators with possible reasons for why a program did not meet its objectives. 
D)  does all of the above.

Question 16

What is evaluability assessment? Name three things an evaluation researcher needs to know to conduct this type of assessment.

Accepted Answer

Evaluability assessment is a systematic

Question 17

Which design is most often used for program evaluation research?

Accepted Answer

A)  single-case 
B)  true experimental 
C)  correlational 
D)  quasi-experimental 
A)  single-case 
B)  true experimental 
C)  correlational 
D)  quasi-experimental

Question 18

Which of the following is NOT a criterion for determining the costs of a program?

Accepted Answer

A)  Is the length of treatment optimal? 
B)  Are the summative assessments appropriate? 
C)  What is the program's budget? 
D)  Will the clients experience negative psychological effects? 
A)  Is the length of treatment optimal? 
B)  Are the summative assessments appropriate? 
C)  What is the program's budget? 
D)  Will the clients experience negative psychological effects?

Question 19

Resistance to a program can come from

Accepted Answer

A)  having a large percentage of clients who have participated in other programs. 
B)  implementing a program for the first time at a specific site. 
C)  a target population that distrusts programs sponsored by outside agencies. 
D)  any of the above 
A)  having a large percentage of clients who have participated in other programs. 
B)  implementing a program for the first time at a specific site. 
C)  a target population that distrusts programs sponsored by outside agencies. 
D)  any of the above

Question 20

Which of the following can negatively affect the goal specification process of evaluation research?

Accepted Answer

A)  Different stakeholder groups might have different ideas about what a particular goal means in practice. 
B)  Program administrators might state program goals in vague terms. 
C)  It is difficult to choose which behaviors best indicate goal attainment. 
D)  all of the above. 
A)  Different stakeholder groups might have different ideas about what a particular goal means in practice. 
B)  Program administrators might state program goals in vague terms. 
C)  It is difficult to choose which behaviors best indicate goal attainment. 
D)  all of the above.

Program implementation can fail for a number of reasons. These reasons include

Professor Martinez wants to determine the degree of change experienced by the client population after a program has been implemented. He can do so by

Which of the following statements about selectively enrolling clients in a program is TRUE?

The reliability of a difference score INCREASES as

Identifying the client population of a program is important because

Name and define three criteria that increase the likelihood that the results of evaluation research will be used by decision makers.

Dr. Char tells a policy maker about the results of his evaluation research because the findings can be used to address political attacks levied at a program. This is an example of ________ utilization of evaluation results.

What factors limit a researcher's ability to conduct a true experiment to assess the program's effectiveness?

Which of the following is a concern with using mean change as an indicator of a program's effectiveness?

In one version of a program, clients participate once a week. In another version, they participate twice a week. Which design would be used to compare the two programs?

_______ evaluation research addresses the needs of all stakeholders.

Dr. Bhalla wants to assess whether on-the-job training improves employee retention. Which of the following would be a summative assessment of the program's effectiveness?

Research on the effectiveness of implementing a program with a new client population is an example of the ________ evaluation research design.

To conduct a proper evaluation, researchers must know, among other things,

Including program theory in the evaluation of a program

What is evaluability assessment? Name three things an evaluation researcher needs to know to conduct this type of assessment.

Which design is most often used for program evaluation research?

Which of the following is NOT a criterion for determining the costs of a program?

Resistance to a program can come from

Which of the following can negatively affect the goal specification process of evaluation research?

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

Program implementation can fail for a number of reasons. These reasons include

Professor Martinez wants to determine the degree of change experienced by the client population after a program has been implemented. He can do so by

Which of the following statements about selectively enrolling clients in a program is TRUE?

The reliability of a difference score INCREASES as

Identifying the client population of a program is important because

Name and define three criteria that increase the likelihood that the results of evaluation research will be used by decision makers.

Dr. Char tells a policy maker about the results of his evaluation research because the findings can be used to address political attacks levied at a program. This is an example of ________ utilization of evaluation results.

What factors limit a researcher's ability to conduct a true experiment to assess the program's effectiveness?

Which of the following is a concern with using mean change as an indicator of a program's effectiveness?

In one version of a program, clients participate once a week. In another version, they participate twice a week. Which design would be used to compare the two programs?

_______ evaluation research addresses the needs of all stakeholders.

Dr. Bhalla wants to assess whether on-the-job training improves employee retention. Which of the following would be a summative assessment of the program's effectiveness?

Research on the effectiveness of implementing a program with a new client population is an example of the ________ evaluation research design.

To conduct a proper evaluation, researchers must know, among other things,

Including program theory in the evaluation of a program

What is evaluability assessment? Name three things an evaluation researcher needs to know to conduct this type of assessment.

Which design is most often used for program evaluation research?

Which of the following is NOT a criterion for determining the costs of a program?

Resistance to a program can come from

Which of the following can negatively affect the goal specification process of evaluation research?

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters