Question 1

Summative evaluations are _________; formative evaluations are __________.

Accepted Answer

A)  essential; nonessential 
B)  high stakes; low stakes 
C)  atheoretical; theory-based 
D)  cost-effective; expensive 
A)  essential; nonessential 
B)  high stakes; low stakes 
C)  atheoretical; theory-based 
D)  cost-effective; expensive

Question 2

Name two threats to internal validity that are unique to evaluation research.

Accepted Answer

Evaluation research, which involves asse

Question 3

________occurs when members of a control group learn about the program being implemented in the treatment group and try to apply it to themselves.

Accepted Answer

A)  Treatment diffusion 
B)  Local contamination 
C)  Resentful demoralization 
D)  Instrumentation change 
A)  Treatment diffusion 
B)  Local contamination 
C)  Resentful demoralization 
D)  Instrumentation change

Question 4

Which of the following cost-related questions can be addressed through evaluation research?

Accepted Answer

A)  Can the same effect be brought about by a shorter program? 
B)  Are there less costly treatment methods that can be used? 
C)  Can the program be delivered by staff members who do not have advanced academic degrees? 
D)  All of the above. 
A)  Can the same effect be brought about by a shorter program? 
B)  Are there less costly treatment methods that can be used? 
C)  Can the program be delivered by staff members who do not have advanced academic degrees? 
D)  All of the above.

Question 5

A ________ analysis compares the dollar cost of operating a program to the dollar benefits that occur when objectives are achieved.

Accepted Answer

A)  program utilization 
B)  cost-benefit 
C)  social-effectiveness 
D)  null result 
A)  program utilization 
B)  cost-benefit 
C)  social-effectiveness 
D)  null result

Question 6

A formative evaluation should include procedures to assess

Accepted Answer

A)  whether the program is being implemented properly. 
B)  sources of client resistance to the program. 
C)  any unintended effects of the program. 
D)  all of the above. 
A)  whether the program is being implemented properly. 
B)  sources of client resistance to the program. 
C)  any unintended effects of the program. 
D)  all of the above.

Question 7

________ outcomes are indirect effects of the program that occur after clients have completed the program.

Accepted Answer

A)  Stakeholder driven 
B)  Proximal 
C)  Social impact 
D)  Policy-focused 
A)  Stakeholder driven 
B)  Proximal 
C)  Social impact 
D)  Policy-focused

Question 8

Evaluation research is perceived by decision makers to be relevant when it

Accepted Answer

A)  addresses the needs of all stakeholder groups. 
B)  produces valid results. 
C)  provides information that can aid in program development. 
D)  includes more than one independent variable. 
A)  addresses the needs of all stakeholder groups. 
B)  produces valid results. 
C)  provides information that can aid in program development. 
D)  includes more than one independent variable.

Question 9

What are social impact outcomes and what do they indicate?

Accepted Answer

Social impact outcomes are the changes t

Question 10

The best program evaluations

Accepted Answer

A)  are theory based. 
B)  use high-utility dependent variables. 
C)  address policy-relevant variables. 
D)  do all of the above 
A)  are theory based. 
B)  use high-utility dependent variables. 
C)  address policy-relevant variables. 
D)  do all of the above

Question 11

Explain the importance of accurate program implementation in evaluation research. Describe two possible sources of implementation failure

Accepted Answer

Accurate program implementation is cruci

Question 12

An evaluation researcher should be most concerned about ________ as a potential threat to internal validity.

Accepted Answer

A)  maturation 
B)  instrumentation change 
C)  nonequivalence of experimental and control groups 
D)  researcher expectancy effects 
A)  maturation 
B)  instrumentation change 
C)  nonequivalence of experimental and control groups 
D)  researcher expectancy effects

Question 13

How can degrees of change be evaluated in a program evaluation study?

Accepted Answer

In a program evaluation study, degrees o

Question 14

Explain why it is important to include both a pretest and a follow-up when assessing the program's effectiveness.

Accepted Answer

It is important to include both a pretes

Question 15

A criterion that can be used to evaluate program impact could be the

Accepted Answer

A)  amount of change brought about by the program. 
B)  costs of the program. 
C)  acceptability of the program to stakeholders. 
D)  all of the above. 
A)  amount of change brought about by the program. 
B)  costs of the program. 
C)  acceptability of the program to stakeholders. 
D)  all of the above.

Question 16

Conflict between stakeholders and evaluators can be reduced by

Accepted Answer

A)  waiting until the program evaluation is designed before involving stakeholders. 
B)  recognizing that stakeholders think they know more than they actually do. 
C)  openly discussing sources of potential conflict. 
D)  deemphasizing the benefits stakeholders might receive from the evaluation process. 
A)  waiting until the program evaluation is designed before involving stakeholders. 
B)  recognizing that stakeholders think they know more than they actually do. 
C)  openly discussing sources of potential conflict. 
D)  deemphasizing the benefits stakeholders might receive from the evaluation process.

Question 17

What factors should a researcher consider when selecting the variables to be included in an evaluation research study?

Accepted Answer

When selecting variables to be included

Question 18

Client resistance to a program can be overcome by

Accepted Answer

A)  considering the viewpoints of all stakeholder groups in the design of the program. 
B)  alleviating potential clients' uncertainties by providing information about aspects of the program that might bother them. 
C)  requiring participation in the program as a condition of receiving other benefits (such as unemployment insurance) so that potential clients can experience the advantages of the program. 
D)  doing either a or b, but not c. 
A)  considering the viewpoints of all stakeholder groups in the design of the program. 
B)  alleviating potential clients' uncertainties by providing information about aspects of the program that might bother them. 
C)  requiring participation in the program as a condition of receiving other benefits (such as unemployment insurance) so that potential clients can experience the advantages of the program. 
D)  doing either a or b, but not c.

Question 19

Describe a research methodology that can be used to address whether a program was effective.

Accepted Answer

One research methodology that can be use

Question 20

The first step in an evaluation research project is

Accepted Answer

A)  program monitoring. 
B)  impact assessment. 
C)  goal definition. 
D)  efficiency analysis. 
A)  program monitoring. 
B)  impact assessment. 
C)  goal definition. 
D)  efficiency analysis.

Summative evaluations are _; formative evaluations are __.

Name two threats to internal validity that are unique to evaluation research.

________occurs when members of a control group learn about the program being implemented in the treatment group and try to apply it to themselves.

Which of the following cost-related questions can be addressed through evaluation research?

A ________ analysis compares the dollar cost of operating a program to the dollar benefits that occur when objectives are achieved.

A formative evaluation should include procedures to assess

________ outcomes are indirect effects of the program that occur after clients have completed the program.

Evaluation research is perceived by decision makers to be relevant when it

What are social impact outcomes and what do they indicate?

The best program evaluations

Explain the importance of accurate program implementation in evaluation research. Describe two possible sources of implementation failure

An evaluation researcher should be most concerned about ________ as a potential threat to internal validity.

How can degrees of change be evaluated in a program evaluation study?

Explain why it is important to include both a pretest and a follow-up when assessing the program's effectiveness.

A criterion that can be used to evaluate program impact could be the

Conflict between stakeholders and evaluators can be reduced by

What factors should a researcher consider when selecting the variables to be included in an evaluation research study?

Client resistance to a program can be overcome by

Describe a research methodology that can be used to address whether a program was effective.

The first step in an evaluation research project is

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

Summative evaluations are _________; formative evaluations are __________.

Name two threats to internal validity that are unique to evaluation research.

________occurs when members of a control group learn about the program being implemented in the treatment group and try to apply it to themselves.

Which of the following cost-related questions can be addressed through evaluation research?

A ________ analysis compares the dollar cost of operating a program to the dollar benefits that occur when objectives are achieved.

A formative evaluation should include procedures to assess

________ outcomes are indirect effects of the program that occur after clients have completed the program.

Evaluation research is perceived by decision makers to be relevant when it

What are social impact outcomes and what do they indicate?

The best program evaluations

Explain the importance of accurate program implementation in evaluation research. Describe two possible sources of implementation failure

An evaluation researcher should be most concerned about ________ as a potential threat to internal validity.

How can degrees of change be evaluated in a program evaluation study?

Explain why it is important to include both a pretest and a follow-up when assessing the program's effectiveness.

A criterion that can be used to evaluate program impact could be the

Conflict between stakeholders and evaluators can be reduced by

What factors should a researcher consider when selecting the variables to be included in an evaluation research study?

Client resistance to a program can be overcome by

Describe a research methodology that can be used to address whether a program was effective.

The first step in an evaluation research project is

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Summative evaluations are _; formative evaluations are __.