Question 1

With regard to evaluation designs, which of the following statements is not accurate?

Accepted Answer

A) variation in the levels of treatment delivered by a program can be a major threat to the validity of even randomized evaluation studies 
B) uncontrolled variation in treatment is equivalent to unreliable measurement of the independent variable 
C) controlled variation in treatment represents a threat to generalizability 
D) varying degrees of participation by clients in a program will impact the outcome 
A) variation in the levels of treatment delivered by a program can be a major threat to the validity of even randomized evaluation studies 
B) uncontrolled variation in treatment is equivalent to unreliable measurement of the independent variable 
C) controlled variation in treatment represents a threat to generalizability 
D) varying degrees of participation by clients in a program will impact the outcome

Question 2

Which of the following does not represent steps in the policy analysis process?

Accepted Answer

A) there is a demand for some new course of action or strong opposition to an existing policy 
B) formulate a hypothesis that will allow for exploration 
C) identify the ultimate goals and the different actions for achieving those goals 
D) consider the impact of the policy outputs 
A) there is a demand for some new course of action or strong opposition to an existing policy 
B) formulate a hypothesis that will allow for exploration 
C) identify the ultimate goals and the different actions for achieving those goals 
D) consider the impact of the policy outputs

Question 3

Outcome measures in evaluation research serve as the independent variables in the research question.

Accepted Answer

A) True 
 B)False

Question 4

Program goals represent _____.

Accepted Answer

A) empirical indicators 
B) desired outcomes 
C) inputs 
D) standards 
A) empirical indicators 
B) desired outcomes 
C) inputs 
D) standards

Question 5

What can be said about the relationship between process evaluations and impact assessments?

Accepted Answer

A) process evaluations can be used in interpreting results from an impact assessment 
B) process evaluations monitor program implementation but impact assessments do not answer questions about a program's effects 
C) process evaluation cannot be used to interpret outcomes 
D) there is no relationship between impact assessments and process evaluations 
A) process evaluations can be used in interpreting results from an impact assessment 
B) process evaluations monitor program implementation but impact assessments do not answer questions about a program's effects 
C) process evaluation cannot be used to interpret outcomes 
D) there is no relationship between impact assessments and process evaluations

Question 6

___________________ are those that have a vested interest in the organization and the outcome of evaluation research.

Accepted Answer

The answer of ___________________ are those that have a vested...

Question 7

Quasi-experiments differ from true experiments in that they lack random assignment to control and experimental groups.

Accepted Answer

A) True 
 B)False

Question 8

All of the following would be examples of goal statements that must be clarified before empirical testing can follow except for _____.

Accepted Answer

A) participants will accept the philosophy of a drug-free life 
B) participants will be equipped with the life skills necessary to succeed 
C) participants will be able to obtain their GED upon completion of the program 
D) provides participants with problem-solving skills 
A) participants will accept the philosophy of a drug-free life 
B) participants will be equipped with the life skills necessary to succeed 
C) participants will be able to obtain their GED upon completion of the program 
D) provides participants with problem-solving skills

Question 9

Which of the following is inaccurate concerning the use of evaluation research?

Accepted Answer

A) it is gaining in popularity among researchers that really want to make a difference 
B) federal requirements for program evaluations often accompany the implementation of new programs 
C) funding is available for program evaluations 
D) Evaluation research may only use experimental design. 
A) it is gaining in popularity among researchers that really want to make a difference 
B) federal requirements for program evaluations often accompany the implementation of new programs 
C) funding is available for program evaluations 
D) Evaluation research may only use experimental design.

Question 10

What are the strengths and weaknesses of quasi-experimental designs? Explain how the use of quasi-experimental designs may be more useful than classical experiments for conducting criminal justice research.

Accepted Answer

Quasi-experimental designs have both str

Question 11

The __________________ refer to the basic question of what a policy action is trying to achieve.

Accepted Answer

The answer of The __________________ refer to the basic question...

Question 12

Treatment integrity is _____.

Accepted Answer

A) roughly equivalent to reliability 
B) roughly equivalent to validity 
C) the difference between the experimental intervention is delivered as intended 
D) both reliable and valid 
A) roughly equivalent to reliability 
B) roughly equivalent to validity 
C) the difference between the experimental intervention is delivered as intended 
D) both reliable and valid

Question 13

If the number of subjects in a program is small, statistical tests can detect only very large program effects of differences in outcome measures between the two groups.This illustrates the problem of _____.

Accepted Answer

A) generalizability 
B) statistical conclusion validity 
C) maturation 
D) reliability 
A) generalizability 
B) statistical conclusion validity 
C) maturation 
D) reliability

Question 14

Randomization may not be appropriate for assignment of people to treatment or programs for all of the following reasons except _____.

Accepted Answer

A) practical reasons 
B) agency support 
C) ethical reasons 
D) legal reasons 
A) practical reasons 
B) agency support 
C) ethical reasons 
D) legal reasons

Question 15

Relating to randomization, which of the following statements is inaccurate?

Accepted Answer

A) as the number of exceptions to random assignment increases, the statistical equivalence of the experimental and control groups decreases 
B) when exceptions to random assignment are made, no bias enters the selection process 
C) randomization in experiments for evaluation purposes are best suited for programs where exceptions are at a minimum 
D) Random assignment of people to receive some especially desirable or punitive treatment may not be possible for legal, ethical, and practical reasons. 
A) as the number of exceptions to random assignment increases, the statistical equivalence of the experimental and control groups decreases 
B) when exceptions to random assignment are made, no bias enters the selection process 
C) randomization in experiments for evaluation purposes are best suited for programs where exceptions are at a minimum 
D) Random assignment of people to receive some especially desirable or punitive treatment may not be possible for legal, ethical, and practical reasons.

Question 16

In the home detention studies used in your text as examples of randomized studies, the authors concluded that _____.

Accepted Answer

A) randomization allows generalization 
B) randomization allows for reliability 
C) randomization does not control for variation in treatment integrity and program delivery 
D) randomization does control for variation in treatment integrity and program delivery 
A) randomization allows generalization 
B) randomization allows for reliability 
C) randomization does not control for variation in treatment integrity and program delivery 
D) randomization does control for variation in treatment integrity and program delivery

Question 17

Learning policy goals is a key first step in doing ________________.

Accepted Answer

The answer of Learning policy goals is a key first...

Question 18

You are a member of student government.Your group has been asked by the President of the University to conduct a study to determine if the newly implemented anti-drinking program all new freshmen are required to take is effective in reducing underage drinking on campus.Identify the goals and outcomes of the program.What type of design would you suggest for such a study and why?

Accepted Answer

The goals of the anti-drinking program f

Question 19

One of the most important parts of conducting evaluation research is _____.

Accepted Answer

A) selecting a sample that will support the program goals 
B) formulating goal statements that are empirically testable 
C) gather official documents since that is where the researcher can find complete descriptions of goals 
D) make sure that the staff of the agency where you conduct research like you by doing anything to get them on your side 
A) selecting a sample that will support the program goals 
B) formulating goal statements that are empirically testable 
C) gather official documents since that is where the researcher can find complete descriptions of goals 
D) make sure that the staff of the agency where you conduct research like you by doing anything to get them on your side

Question 20

Which of the following does not represent potential problems in doing evaluation research?

Accepted Answer

A) conflicting goals 
B) vague goals 
C) when the intended actions and goals are linked through empirical evidence. 
D) difficulty in expressing policy goals in the "if-then" form that can be empirically tested 
A) conflicting goals 
B) vague goals 
C) when the intended actions and goals are linked through empirical evidence. 
D) difficulty in expressing policy goals in the "if-then" form that can be empirically tested

With regard to evaluation designs, which of the following statements is not accurate?

Which of the following does not represent steps in the policy analysis process?

Outcome measures in evaluation research serve as the independent variables in the research question.

Program goals represent _____.

What can be said about the relationship between process evaluations and impact assessments?

___________________ are those that have a vested interest in the organization and the outcome of evaluation research.

Quasi-experiments differ from true experiments in that they lack random assignment to control and experimental groups.

All of the following would be examples of goal statements that must be clarified before empirical testing can follow except for _____.

Which of the following is inaccurate concerning the use of evaluation research?

What are the strengths and weaknesses of quasi-experimental designs? Explain how the use of quasi-experimental designs may be more useful than classical experiments for conducting criminal justice research.

The __________________ refer to the basic question of what a policy action is trying to achieve.

Treatment integrity is _____.

If the number of subjects in a program is small, statistical tests can detect only very large program effects of differences in outcome measures between the two groups.This illustrates the problem of _____.

Randomization may not be appropriate for assignment of people to treatment or programs for all of the following reasons except _____.

Relating to randomization, which of the following statements is inaccurate?

In the home detention studies used in your text as examples of randomized studies, the authors concluded that _____.

Learning policy goals is a key first step in doing ________________.

One of the most important parts of conducting evaluation research is _____.

Which of the following does not represent potential problems in doing evaluation research?

Criminal Justice and Scientific Inquiry

Ethics and Criminal Justice Research

General Issues in Research Design

Concepts, Operationalization, and Measurement

Experimental and Quasi-Experimental Designs

Sampling

Survey Research and Other Ways of Asking Questions

Field Research

Agency Records, Content Analysis, and Secondary Data

Interpreting Data

Filters

Exam 10: Evaluation Research and Problem Analysis

With regard to evaluation designs, which of the following statements is not accurate?

Which of the following does not represent steps in the policy analysis process?

Outcome measures in evaluation research serve as the independent variables in the research question.

Program goals represent _____.

What can be said about the relationship between process evaluations and impact assessments?

___________________ are those that have a vested interest in the organization and the outcome of evaluation research.

Quasi-experiments differ from true experiments in that they lack random assignment to control and experimental groups.

All of the following would be examples of goal statements that must be clarified before empirical testing can follow except for _____.

Which of the following is inaccurate concerning the use of evaluation research?

What are the strengths and weaknesses of quasi-experimental designs? Explain how the use of quasi-experimental designs may be more useful than classical experiments for conducting criminal justice research.

The __________________ refer to the basic question of what a policy action is trying to achieve.

Treatment integrity is _____.

If the number of subjects in a program is small, statistical tests can detect only very large program effects of differences in outcome measures between the two groups.This illustrates the problem of _____.

Randomization may not be appropriate for assignment of people to treatment or programs for all of the following reasons except _____.

Relating to randomization, which of the following statements is inaccurate?

In the home detention studies used in your text as examples of randomized studies, the authors concluded that _____.

Learning policy goals is a key first step in doing ________________.

One of the most important parts of conducting evaluation research is _____.

Which of the following does not represent potential problems in doing evaluation research?

Criminal Justice and Scientific Inquiry

Ethics and Criminal Justice Research

General Issues in Research Design

Concepts, Operationalization, and Measurement

Experimental and Quasi-Experimental Designs

Sampling

Survey Research and Other Ways of Asking Questions

Field Research

Agency Records, Content Analysis, and Secondary Data

Interpreting Data

Filters