Question 1

Which of the following is NOT a good indicator of the importance of the change brought about by a program?

Accepted Answer

A)  the percentage of clients who meet a predetermined criterion for improvement 
B)  the number of program goals that were achieved 
C)  the average amount of change brought about by the program 
D)  the durability of the program's outcomes 
A)  the percentage of clients who meet a predetermined criterion for improvement 
B)  the number of program goals that were achieved 
C)  the average amount of change brought about by the program 
D)  the durability of the program's outcomes

Question 2

A ________ evaluation involves continuously assessing how well a program is being implemented while it is being carried out.

Accepted Answer

A)  summative 
B)  cumulative 
C)  formative 
D)  client-focused 
A)  summative 
B)  cumulative 
C)  formative 
D)  client-focused

Question 3

Explain how political motivations can affect whether the results of evaluation research are utilized or ignored.

Accepted Answer

Political motivations can greatly affect

Question 4

Clients might resist using a program because

Accepted Answer

A)  they are unable to access it due to such factors as restricted operating hours. 
B)  they see the required procedures as demeaning. 
C)  the program does not fit with the client population's culture. 
D)  any of the above. 
A)  they are unable to access it due to such factors as restricted operating hours. 
B)  they see the required procedures as demeaning. 
C)  the program does not fit with the client population's culture. 
D)  any of the above.

Question 5

Explain why it is important to identify the client population when developing a program evaluation

Accepted Answer

It is important to identify the client p

Question 6

In evaluation research, which of the following determines whether a problem exists and then points to a solution?

Accepted Answer

A)  needs assessment 
B)  impact evaluation 
C)  evaluability assessment 
D)  program monitoring 
A)  needs assessment 
B)  impact evaluation 
C)  evaluability assessment 
D)  program monitoring

Question 7

Which design would best answer this question: "How can the program be improved?"

Accepted Answer

A)  client and program variation 
B)  constructive 
C)  parametric 
D)  either b or c, but not a 
A)  client and program variation 
B)  constructive 
C)  parametric 
D)  either b or c, but not a

Question 8

What is an efficiency analysis? Name one research question that can be answered and one question that cannot be answered by using such an analysis.

Accepted Answer

Efficiency analysis is a process of eval

Question 9

_____ evaluations are carried out even though no one has any intention of applying the results to the program.

Accepted Answer

A)  Low-utility 
B)  Ritual 
C)  Stakeholder 
D)  Political 
A)  Low-utility 
B)  Ritual 
C)  Stakeholder 
D)  Political

Question 10

Distinguish between instrumental, persuasive, and conceptual utilization of the information gained by a program evaluation.

Accepted Answer

Instrumental utilization of information

Question 11

Define needs assessment and describe the factors that a researcher should consider when completing this assessment.

Accepted Answer

Needs assessment is a systematic process

Question 12

How is change assessed in evaluation research? Explain why it is important to assess change from both a statistical and a practical perspective.

Accepted Answer

Change is assessed in evaluation researc

Question 13

List three questions that a researcher should answer to determine the effectiveness of an evaluation research study.

Accepted Answer

1. What specific goals or objectives wer

Question 14

A proper evaluation research design assesses clients and control participants on the dependent variable at least

Accepted Answer

A)  once: at the end of treatment. 
B)  twice: at the beginning of treatment and at the end of treatment. 
C)  three times: at the beginning of treatment, at the end of treatment, and at a follow-up after the end of treatment. 
D)  none of the above: there is no minimum number of assessments that is considered essential for an effective evaluation. 
A)  once: at the end of treatment. 
B)  twice: at the beginning of treatment and at the end of treatment. 
C)  three times: at the beginning of treatment, at the end of treatment, and at a follow-up after the end of treatment. 
D)  none of the above: there is no minimum number of assessments that is considered essential for an effective evaluation.

Question 15

Distal outcomes are also called

Accepted Answer

A)  social impact outcomes. 
B)  proximal causes. 
C)  policy-focused outcomes. 
D)  stakeholder goals. 
A)  social impact outcomes. 
B)  proximal causes. 
C)  policy-focused outcomes. 
D)  stakeholder goals.

Question 16

The persuasive utilization of evaluation research occurs when the results

Accepted Answer

A)  are used to improve future research designs. 
B)  are directly used for making decisions or solving problems. 
C)  influence a policy maker's thinking on an issue even if they do not have a direct effect on decision-making. 
D)  are used as evidence to defend a political position from attack. 
A)  are used to improve future research designs. 
B)  are directly used for making decisions or solving problems. 
C)  influence a policy maker's thinking on an issue even if they do not have a direct effect on decision-making. 
D)  are used as evidence to defend a political position from attack.

Question 17

Unintended effects of a program

Accepted Answer

A)  are always negative. 
B)  can counteract the intended effects of the program. 
C)  are distractions from the proper evaluation of the program. 
D)  are any of the above. 
A)  are always negative. 
B)  can counteract the intended effects of the program. 
C)  are distractions from the proper evaluation of the program. 
D)  are any of the above.

Question 18

________ outcomes are direct effects of the program that can be expected to occur while the clients are taking part in the program.

Accepted Answer

A)  Social impact 
B)  Proximal 
C)  Distal 
D)  Client-centered 
A)  Social impact 
B)  Proximal 
C)  Distal 
D)  Client-centered

Question 19

A non-profit organization wants to design an effective AIDS prevention program for a developing country. They hire Dr. Joyeaux to assist them. He thinks they should first determine whether AIDS is indeed a problem in that country. Which program goal is he addressing?

Accepted Answer

A)  impact evaluation 
B)  program monitoring 
C)  evaluability assessment 
D)  needs assessment 
A)  impact evaluation 
B)  program monitoring 
C)  evaluability assessment 
D)  needs assessment

Question 20

Distinguish between formative and summative evaluation. Give an example of each.

Accepted Answer

Formative evaluation and summative evalu

Which of the following is NOT a good indicator of the importance of the change brought about by a program?

A ________ evaluation involves continuously assessing how well a program is being implemented while it is being carried out.

Explain how political motivations can affect whether the results of evaluation research are utilized or ignored.

Clients might resist using a program because

Explain why it is important to identify the client population when developing a program evaluation

In evaluation research, which of the following determines whether a problem exists and then points to a solution?

Which design would best answer this question: "How can the program be improved?"

What is an efficiency analysis? Name one research question that can be answered and one question that cannot be answered by using such an analysis.

_____ evaluations are carried out even though no one has any intention of applying the results to the program.

Distinguish between instrumental, persuasive, and conceptual utilization of the information gained by a program evaluation.

Define needs assessment and describe the factors that a researcher should consider when completing this assessment.

How is change assessed in evaluation research? Explain why it is important to assess change from both a statistical and a practical perspective.

List three questions that a researcher should answer to determine the effectiveness of an evaluation research study.

A proper evaluation research design assesses clients and control participants on the dependent variable at least

Distal outcomes are also called

The persuasive utilization of evaluation research occurs when the results

Unintended effects of a program

________ outcomes are direct effects of the program that can be expected to occur while the clients are taking part in the program.

A non-profit organization wants to design an effective AIDS prevention program for a developing country. They hire Dr. Joyeaux to assist them. He thinks they should first determine whether AIDS is indeed a problem in that country. Which program goal is he addressing?

Distinguish between formative and summative evaluation. Give an example of each.

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

Which of the following is NOT a good indicator of the importance of the change brought about by a program?

A ________ evaluation involves continuously assessing how well a program is being implemented while it is being carried out.

Explain how political motivations can affect whether the results of evaluation research are utilized or ignored.

Clients might resist using a program because

Explain why it is important to identify the client population when developing a program evaluation

In evaluation research, which of the following determines whether a problem exists and then points to a solution?

Which design would best answer this question: "How can the program be improved?"

What is an efficiency analysis? Name one research question that can be answered and one question that cannot be answered by using such an analysis.

_____ evaluations are carried out even though no one has any intention of applying the results to the program.

Distinguish between instrumental, persuasive, and conceptual utilization of the information gained by a program evaluation.

Define needs assessment and describe the factors that a researcher should consider when completing this assessment.

How is change assessed in evaluation research? Explain why it is important to assess change from both a statistical and a practical perspective.

List three questions that a researcher should answer to determine the effectiveness of an evaluation research study.

A proper evaluation research design assesses clients and control participants on the dependent variable at least

Distal outcomes are also called

The persuasive utilization of evaluation research occurs when the results

Unintended effects of a program

________ outcomes are direct effects of the program that can be expected to occur while the clients are taking part in the program.

A non-profit organization wants to design an effective AIDS prevention program for a developing country. They hire Dr. Joyeaux to assist them. He thinks they should first determine whether AIDS is indeed a problem in that country. Which program goal is he addressing?

Distinguish between formative and summative evaluation. Give an example of each.

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters