Question 1

The conceptual utilization of the results of evaluation research occurs when the results

Accepted Answer

A)  are used to improve future research designs. 
B)  influence a policy maker's thinking on an issue. 
C)  are used as evidence to defend a political position from attack. 
D)  do any of the above 
A)  are used to improve future research designs. 
B)  influence a policy maker's thinking on an issue. 
C)  are used as evidence to defend a political position from attack. 
D)  do any of the above

Question 2

Define client resistance in evaluation research and explain why it might happen. How can this resistance be reduced?

Accepted Answer

Client resistance in evaluation research

Question 3

Which design would best answer this question: "Which components are most essential for the success of the program?"

Accepted Answer

A)  program package 
B)  dismantling 
C)  constructive 
D)  parametric 
A)  program package 
B)  dismantling 
C)  constructive 
D)  parametric

Question 4

Name three factors that evaluation researchers should consider when developing a solution to an identified problem.

Accepted Answer

When developing a solution to an identif

Question 5

What is the minimum number of time points needed in an evaluation research study?

Accepted Answer

A)  one 
B)  two 
C)  three 
D)  four 
A)  one 
B)  two 
C)  three 
D)  four

Question 6

Needs assessment is an important part of program evaluation. Which statement about this process is TRUE?

Accepted Answer

A)  The client population need not be identified at this stage in the evaluation process. 
B)  Because program evaluation has an applied focus, theories are not relevant to needs assessment. 
C)  Policy makers' perceptions that a problem exists might be inaccurate. 
D)  The goals of an intervention are determined prior to the involvement of the program evaluators. 
A)  The client population need not be identified at this stage in the evaluation process. 
B)  Because program evaluation has an applied focus, theories are not relevant to needs assessment. 
C)  Policy makers' perceptions that a problem exists might be inaccurate. 
D)  The goals of an intervention are determined prior to the involvement of the program evaluators.

Question 7

Name three advantages of conducting a theory-based program evaluation.

Accepted Answer

Conducting a theory-based program evalua

Question 8

In which of the following measures is a person's difference score divided by the standard error of the difference?

Accepted Answer

A)  reliability of the difference 
B)  reliable change index 
C)  effect size 
D)  correlated difference score 
A)  reliability of the difference 
B)  reliable change index 
C)  effect size 
D)  correlated difference score

Question 9

Which design would best answer the evaluation research question of "Is the program effective?"

Accepted Answer

A)  program package 
B)  client and program variation 
C)  constructive 
D)  parametric 
A)  program package 
B)  client and program variation 
C)  constructive 
D)  parametric

Question 10

Name and describe two research designs that can be used to assess whether an evaluation program can be improved.

Accepted Answer

Two research designs that can be used to

Question 11

A ________ analysis compares the cost of a program to the size of its outcomes.

Accepted Answer

A)  program utilization 
B)  cost-benefit 
C)  cost-effectiveness 
D)  null result 
A)  program utilization 
B)  cost-benefit 
C)  cost-effectiveness 
D)  null result

Question 12

Null results can occur in evaluation research because

Accepted Answer

A)  the program did not meet its objectives. 
B)  the study did not have sufficient statistical power to detect an effect of the program. 
C)  the researchers did not properly operationally define the variables in the study. 
D)  of any of the above. 
A)  the program did not meet its objectives. 
B)  the study did not have sufficient statistical power to detect an effect of the program. 
C)  the researchers did not properly operationally define the variables in the study. 
D)  of any of the above.

Question 13

Evaluation research is perceived by decision makers to be true when it

Accepted Answer

A)  addresses the needs of all stakeholder groups. 
B)  produces valid results. 
C)  provides information that can aid in program development. 
D)  includes more than one independent variable. 
A)  addresses the needs of all stakeholder groups. 
B)  produces valid results. 
C)  provides information that can aid in program development. 
D)  includes more than one independent variable.

Question 14

In evaluation research, the process of goal specification is analogous to the process of ________ in experimental research.

Accepted Answer

A)  developing manipulations of independent variables 
B)  operationally defining dependent variables 
C)  identifying extraneous variables that need to be controlled 
D)  identifying the research population 
A)  developing manipulations of independent variables 
B)  operationally defining dependent variables 
C)  identifying extraneous variables that need to be controlled 
D)  identifying the research population

Question 15

______evaluation research produces valid results.

Accepted Answer

A)  Relevant 
B)  True 
C)  High utility 
D)  Cost-effective 
A)  Relevant 
B)  True 
C)  High utility 
D)  Cost-effective

Question 16

What is a dismantling design? How can it be used to evaluate whether a program was effective?

Accepted Answer

A dismantling design is a type of experi

Question 17

Dr. Case decides to use a pre-experimental design for her program evaluation. Her decision is defensible if

Accepted Answer

A)  she can rule out all local history effects. 
B)  it is impossible to come up with a no-treatment control group. 
C)  she is concerned about treatment diffusion effects. 
D)  the program might produce resentful demoralization in a control group. 
A)  she can rule out all local history effects. 
B)  it is impossible to come up with a no-treatment control group. 
C)  she is concerned about treatment diffusion effects. 
D)  the program might produce resentful demoralization in a control group.

Question 18

In evaluation research, difference scores

Accepted Answer

A)  are used to assess change. 
B)  are used to identify which individual clients did or did not benefit. 
C)  can indicate whether the results have high utility. 
D)  do all of the above 
A)  are used to assess change. 
B)  are used to identify which individual clients did or did not benefit. 
C)  can indicate whether the results have high utility. 
D)  do all of the above

Question 19

What is local history and when is it most likely to threaten the internal validity of an evaluation research study?

Accepted Answer

Local history refers to specific events

Question 20

Which of the following is NOT an example of control group contamination?

Accepted Answer

A)  instrumentation change 
B)  resentful demoralization 
C)  rivalry 
D)  treatment diffusion 
A)  instrumentation change 
B)  resentful demoralization 
C)  rivalry 
D)  treatment diffusion

The conceptual utilization of the results of evaluation research occurs when the results

Define client resistance in evaluation research and explain why it might happen. How can this resistance be reduced?

Which design would best answer this question: "Which components are most essential for the success of the program?"

Name three factors that evaluation researchers should consider when developing a solution to an identified problem.

What is the minimum number of time points needed in an evaluation research study?

Needs assessment is an important part of program evaluation. Which statement about this process is TRUE?

Name three advantages of conducting a theory-based program evaluation.

In which of the following measures is a person's difference score divided by the standard error of the difference?

Which design would best answer the evaluation research question of "Is the program effective?"

Name and describe two research designs that can be used to assess whether an evaluation program can be improved.

A ________ analysis compares the cost of a program to the size of its outcomes.

Null results can occur in evaluation research because

Evaluation research is perceived by decision makers to be true when it

In evaluation research, the process of goal specification is analogous to the process of ________ in experimental research.

______evaluation research produces valid results.

What is a dismantling design? How can it be used to evaluate whether a program was effective?

Dr. Case decides to use a pre-experimental design for her program evaluation. Her decision is defensible if

In evaluation research, difference scores

What is local history and when is it most likely to threaten the internal validity of an evaluation research study?

Which of the following is NOT an example of control group contamination?

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters

Exam 16: Evaluation Research

The conceptual utilization of the results of evaluation research occurs when the results

Define client resistance in evaluation research and explain why it might happen. How can this resistance be reduced?

Which design would best answer this question: "Which components are most essential for the success of the program?"

Name three factors that evaluation researchers should consider when developing a solution to an identified problem.

What is the minimum number of time points needed in an evaluation research study?

Needs assessment is an important part of program evaluation. Which statement about this process is TRUE?

Name three advantages of conducting a theory-based program evaluation.

In which of the following measures is a person's difference score divided by the standard error of the difference?

Which design would best answer the evaluation research question of "Is the program effective?"

Name and describe two research designs that can be used to assess whether an evaluation program can be improved.

A ________ analysis compares the cost of a program to the size of its outcomes.

Null results can occur in evaluation research because

Evaluation research is perceived by decision makers to be true when it

In evaluation research, the process of goal specification is analogous to the process of ________ in experimental research.

______evaluation research produces valid results.

What is a dismantling design? How can it be used to evaluate whether a program was effective?

Dr. Case decides to use a pre-experimental design for her program evaluation. Her decision is defensible if

In evaluation research, difference scores

What is local history and when is it most likely to threaten the internal validity of an evaluation research study?

Which of the following is NOT an example of control group contamination?

Behavioral Science

Research Strategies: an Overview

The Ethical Treatment of Research Participants

The Professional and Social Responsibilities of Scientists

Formulating a Research Question

Developing a Measurement Strategy

The Internal Validity of Research

The External Validity of Research

True Experiments

Field Research

Correlational Designs

Factor Analysis, Path Analysis, and Structural Equation Modeling

The Single-Case Research Strategy

Qualitative Research and Interviewing, Rachel Kraus, Ball State University

Survey Research

Data Collection

Interpreting Research Results

Literature Reviewing

Filters