Question 1

Which of the following is accurate with respect to the relationship between impacts and outputs?

Accepted Answer

A)  outputs are policy actions while impacts are goals 
B)  impacts are related to what the policy goals attempt to achieve while outputs are related to the means of achieving the goals 
C)  impacts are the goals and outputs are what is achieved 
D)  outputs are policy goals while impacts are how the policies are applied 
A)  outputs are policy actions while impacts are goals 
B)  impacts are related to what the policy goals attempt to achieve while outputs are related to the means of achieving the goals 
C)  impacts are the goals and outputs are what is achieved 
D)  outputs are policy goals while impacts are how the policies are applied

Question 2

Whether an experimental intervention is delivered as intended describes

Accepted Answer

A)  Treatment fidelity. 
B)  Treatment integrity. 
C)  Treatment seclusion. 
D)  Treatment devotion. 
A)  Treatment fidelity. 
B)  Treatment integrity. 
C)  Treatment seclusion. 
D)  Treatment devotion.

Question 3

A(n) ____________________ refers to researchers and program personnel together considering how each program element affects the targets.

Accepted Answer

The answer of A(n) ____________________ refers to researchers and program...

Question 4

Which of the following is not correct with respect to process evaluations?

Accepted Answer

A)  information about program implementation can be linked to outcome measures, even when accompanied by a process evaluation 
B)  process evaluation aids in interpreting results from impact assessments 
C)  process evaluations are useful when a researcher is interested in the performance of specific tasks within a program 
D)  process evaluations assume that tasks within a program are linked to program outcomes 
A)  information about program implementation can be linked to outcome measures, even when accompanied by a process evaluation 
B)  process evaluation aids in interpreting results from impact assessments 
C)  process evaluations are useful when a researcher is interested in the performance of specific tasks within a program 
D)  process evaluations assume that tasks within a program are linked to program outcomes

Question 5

What is the fundamental first step in conducting evaluation studies?

Accepted Answer

A)  measuring program goals 
B)  obtaining evaluable statements 
C)  specifying outcomes 
D)  clearly specifying program goals 
A)  measuring program goals 
B)  obtaining evaluable statements 
C)  specifying outcomes 
D)  clearly specifying program goals

Question 6

A scouting report is a product of:

Accepted Answer

A)  a process evaluation 
B)  an outcome evaluation 
C)  an evaluability assessment 
D)  defining policy objectives 
A)  a process evaluation 
B)  an outcome evaluation 
C)  an evaluability assessment 
D)  defining policy objectives

Question 7

Evaluation apprehension occurs when people fear that their own job performance is being rated.

Accepted Answer

A) True 
 B)False

Question 8

Randomized experiments for evaluation purposes require which of the following?

Accepted Answer

A)  case flow must be adequate to produce enough subjects in both the experimental and the control groups 
B)  program staff must accept random assignment and minimize the exceptions to randomization 
C)  experimental interventions must be consistently applied 
D)  all of the above 
A)  case flow must be adequate to produce enough subjects in both the experimental and the control groups 
B)  program staff must accept random assignment and minimize the exceptions to randomization 
C)  experimental interventions must be consistently applied 
D)  all of the above

Question 9

Problem analysis focuses upon whether the intended result was produced.

Accepted Answer

A) True 
 B)False

Question 10

Your criminal justice department has been requiring graduating seniors to take an exit exam as a measure of departmental outcomes. How could that tool be used to determine if the criminal justice major is effective?

Accepted Answer

The exit exam for graduating seniors in

Question 11

____________________ takes place in the policymaking stage while program evaluation studies are conducted in later stages.

Accepted Answer

The answer of ____________________ takes place in the policymaking stage...

Question 12

Which of the following is not a concern when a researcher uses an interrupted time-series design?

Accepted Answer

A)  reliability of experimental treatment 
B)  history 
C)  instrumentation 
D)  construct validity 
A)  reliability of experimental treatment 
B)  history 
C)  instrumentation 
D)  construct validity

Question 13

When dealing with stakeholders a researcher should be aware of all of the following except:

Accepted Answer

A)  be able to identify all the stakeholders 
B)  get particularly friendly with the stakeholders so they will not interfere with your research 
C)  find out the stakeholders' perspectives on the program 
D)  find out the stakeholders' perspectives on the evaluation 
A)  be able to identify all the stakeholders 
B)  get particularly friendly with the stakeholders so they will not interfere with your research 
C)  find out the stakeholders' perspectives on the program 
D)  find out the stakeholders' perspectives on the evaluation

Question 14

Which of the following represents potential problems in doing evaluation research?

Accepted Answer

A)  conflicting goals 
B)  clearly stated goals 
C)  ability to express policy goals in the "if-then" form that can be empirically tested 
D)  all of the above 
A)  conflicting goals 
B)  clearly stated goals 
C)  ability to express policy goals in the "if-then" form that can be empirically tested 
D)  all of the above

Question 15

A policy ____________________ is an action taken for the purpose of producing some intended result.

Accepted Answer

The answer of A policy ____________________ is an action taken...

Question 16

Which of the following does not represent steps in the policy analysis process?

Accepted Answer

A)  there is a demand for some new course of action or strong opposition to an existing policy 
B)  formulate a hypothesis that will allow for exploration 
C)  identify the ultimate goals and the different actions for achieving those goals 
D)  consider the impact of the policy outputs 
A)  there is a demand for some new course of action or strong opposition to an existing policy 
B)  formulate a hypothesis that will allow for exploration 
C)  identify the ultimate goals and the different actions for achieving those goals 
D)  consider the impact of the policy outputs

Question 17

Process evaluations:

Accepted Answer

A)  assess the extent to which policies achieve their intended goals 
B)  are essentially the same as impact assessments 
C)  focus on policy demands and agenda 
D)  assess the extent to which policies are being implemented as intended 
A)  assess the extent to which policies achieve their intended goals 
B)  are essentially the same as impact assessments 
C)  focus on policy demands and agenda 
D)  assess the extent to which policies are being implemented as intended

Question 18

Any public policy discussion involves politics. Which of the following is not accurate with respect to ethics and the political aspects of applied research?

Accepted Answer

A)  there is no set of political norms that are agreed upon by all criminal justice researchers 
B)  just as there are codes for ethical conduct for researchers, there are formal codes of accepted political conduct 
C)  ethics of criminal justice research deals more with the methods used while political issues are more concerned with the substance and use of the research 
D)  there is no formal code of accepted political conduct 
A)  there is no set of political norms that are agreed upon by all criminal justice researchers 
B)  just as there are codes for ethical conduct for researchers, there are formal codes of accepted political conduct 
C)  ethics of criminal justice research deals more with the methods used while political issues are more concerned with the substance and use of the research 
D)  there is no formal code of accepted political conduct

Question 19

In which of the following would a researcher be least likely to use randomized designs?

Accepted Answer

A)  program evaluation studies 
B)  ex post evaluations 
C)  victim-centered studies 
D)  time-series designs 
A)  program evaluation studies 
B)  ex post evaluations 
C)  victim-centered studies 
D)  time-series designs

Question 20

Stakeholders are persons and organizations with an indirect interest in a program.

Accepted Answer

A) True 
 B)False

Which of the following is accurate with respect to the relationship between impacts and outputs?

Whether an experimental intervention is delivered as intended describes

A(n) ____________________ refers to researchers and program personnel together considering how each program element affects the targets.

Which of the following is not correct with respect to process evaluations?

What is the fundamental first step in conducting evaluation studies?

A scouting report is a product of:

Evaluation apprehension occurs when people fear that their own job performance is being rated.

Randomized experiments for evaluation purposes require which of the following?

Problem analysis focuses upon whether the intended result was produced.

Your criminal justice department has been requiring graduating seniors to take an exit exam as a measure of departmental outcomes. How could that tool be used to determine if the criminal justice major is effective?

____________________ takes place in the policymaking stage while program evaluation studies are conducted in later stages.

Which of the following is not a concern when a researcher uses an interrupted time-series design?

When dealing with stakeholders a researcher should be aware of all of the following except:

Which of the following represents potential problems in doing evaluation research?

A policy ____________________ is an action taken for the purpose of producing some intended result.

Which of the following does not represent steps in the policy analysis process?

Process evaluations:

Any public policy discussion involves politics. Which of the following is not accurate with respect to ethics and the political aspects of applied research?

In which of the following would a researcher be least likely to use randomized designs?

Stakeholders are persons and organizations with an indirect interest in a program.

Crime Criminal Justice and Scientific Inquiry

Foundations of Criminal Justice Research

Ethics and Criminal Justice Research

General Issues in Research Design

Concepts Operationalization and Measurement

Measuring Crime

Experimental and Quasi Experimental Designs

Sampling

Survey Research

Qualitative Interviewing

Field Observation

Agency Records Content Analysis and Secondary Data

Interpreting Data

Filters

Exam 13: Evaluation Research and Problem Analysis

Which of the following is accurate with respect to the relationship between impacts and outputs?

Whether an experimental intervention is delivered as intended describes

A(n) ____________________ refers to researchers and program personnel together considering how each program element affects the targets.

Which of the following is not correct with respect to process evaluations?

What is the fundamental first step in conducting evaluation studies?

A scouting report is a product of:

Evaluation apprehension occurs when people fear that their own job performance is being rated.

Randomized experiments for evaluation purposes require which of the following?

Problem analysis focuses upon whether the intended result was produced.

Your criminal justice department has been requiring graduating seniors to take an exit exam as a measure of departmental outcomes. How could that tool be used to determine if the criminal justice major is effective?

____________________ takes place in the policymaking stage while program evaluation studies are conducted in later stages.

Which of the following is not a concern when a researcher uses an interrupted time-series design?

When dealing with stakeholders a researcher should be aware of all of the following except:

Which of the following represents potential problems in doing evaluation research?

A policy ____________________ is an action taken for the purpose of producing some intended result.

Which of the following does not represent steps in the policy analysis process?

Process evaluations:

Any public policy discussion involves politics. Which of the following is not accurate with respect to ethics and the political aspects of applied research?

In which of the following would a researcher be least likely to use randomized designs?

Stakeholders are persons and organizations with an indirect interest in a program.

Crime Criminal Justice and Scientific Inquiry

Foundations of Criminal Justice Research

Ethics and Criminal Justice Research

General Issues in Research Design

Concepts Operationalization and Measurement

Measuring Crime

Experimental and Quasi Experimental Designs

Sampling

Survey Research

Qualitative Interviewing

Field Observation

Agency Records Content Analysis and Secondary Data

Interpreting Data

Filters