Deck 11: Section 2: Evaluation Research and Problem Analysis Glossary

Question 1

Justice agencies have come to rely more on evidence-based policy, in which the actions of justice agencies are linked to evidence used for planning and evaluation.

Answer 1

True

Question 2

Treatment integrity or treatment consistency refers to whether an experimental intervention is delivered as intended. It is almost equivalent to _____. Experimental designs in applied studies often suffer from problems related to treatment inconsistencies.

A) measurement reliability
B) measurement reliability
C) measurement reliability
D) measurement reliability

Answer 2

A
Explanation:
A. This is an incorrect answer because treatment integrity is equivalent to measurement reliability. Experimental designs in applied studies often suffer from problems related to treatment inconsistencies. For example if serving time in jail is the experimental treatment in a program designed to test different approaches to sentencing drunk drivers, treatment integrity will be threatened if some defendants are sentenced to a weekend in jail while others serve 30 days or longer.
B. The correct answer is "B" because treatment integrity is equivalent to measurement reliability. Experimental designs in applied studies often suffer from problems related to treatment inconsistencies. For example if serving time in jail is the experimental treatment in a program designed to test different approaches to sentencing drunk drivers, treatment integrity will be threatened if some defendants are sentenced to a weekend in jail while others serve 30 days or longer.
C. This is an incorrect answer because treatment integrity is equivalent to measurement reliability. Experimental designs in applied studies often suffer from problems related to treatment inconsistencies. For example if serving time in jail is the experimental treatment in a program designed to test different approaches to sentencing drunk drivers, treatment integrity will be threatened if some defendants are sentenced to a weekend in jail while others serve 30 days or longer.
D. This is an incorrect answer because treatment integrity is equivalent to measurement reliability. Experimental designs in applied studies often suffer from problems related to treatment inconsistencies. For example if serving time in jail is the experimental treatment in a program designed to test different approaches to sentencing drunk drivers, treatment integrity will be threatened if some defendants are sentenced to a weekend in jail while others serve 30 days or longer.

Question 3

Problem analysis is another type of evaluation research. It helps public officials plan and select alternative actions. Not all types of designs, measures, and data collection techniques can be used in evaluation research and problem analysis.

Answer 3

False
Explanation:
This is false because virtually all types of designs, measures, and data collection techniques can be used in evaluation research and problem analysis. . Problem analysis is another type of evaluation research. It helps public officials plan and select alternative actions.

Question 4

Increased federal requirements for program evaluations to accompany the implementation of new programs, and the availability of research funds to meet that requirement are some of the main reasons for the growth of _____ research. However, increased interest in program evaluation and problem analysis has followed heightened concern for the accountability of public officials and public policy.

A) quantitative
B) empirical
C) qualitative
D) evaluation

Question 5

Specifying program goals is a fundamental first step in conducting evaluation
Studies. If officials are not certain about _____, it is not possible to determine whether goals are reached. If different stakeholders embrace different goals, evaluators must specify different ways to assess those goals.

A) what a program is expected to confirm
B) what a program is expected to conduct
C) what a program is expected to embrace
D) what a program is expected to achieve

Question 6

Problem analysis is another type of evaluation research. It helps public officials plan and select alternative actions. Almost all types of designs, measures, and data collection techniques can be used in _____ and problem analysis.

A) classical experiment research
B) empirical research
C) quasi-experimental research
D) evaluation research

Question 7

Evaluation research does not play any significant role in program development and policy making.

Question 8

Increased federal requirements for program evaluations to accompany the implementation of new programs, and the availability of research funds to meet that requirement are some of the main reasons for the growth of evaluation research.

Question 9

Program evaluation is different from problem analysis. Program evaluation is the process that seeks to link the _____ of criminal justice policy to empirical evidence that policies are being carried out as planned and are having the desired effects.

A) past actions and future goals
B) criminal activities and punishments
C) intended actions and goals
D) program objectives and goals

Question 10

An evaluability assessment is a "pre-evaluation," in which a researcher determines whether conditions necessary for conducting an evaluation are present. One obvious condition is _____ that will be evaluated.

A) support for the study from organizations delivering program components
B) financial support from organizations delivering program components
C) support in form of personnel from organizations delivering program components
D) support for the research staff from organizations delivering program components

Question 11

The policy process begins with a demand that normally appears as support for a new course of action or opposition to existing policy. Such demands can emerge from _____ sources. For example, widely publicized cases of racial discrimination in drug sentencing eventually led to the revision of federal sentencing guidelines for drug offenses.

A) within an agency or from outside
B) within a public organization or from outside
C) within a conceptual framework or from outside
D) within a union of workers or from outside

Question 12

A growing number of law enforcement agencies are using computerized crime maps to _____. Producing computer-generated maps that display reported crimes within days after they have occurred is one of the most important policy planning tools for the New York City Police
Department.

A) detect emerging patterns in crime and develop appropriate responses
B) detect emerging new in crime spots and develop hot spot detection
C) detect emerging patterns in population increase and develop appropriate policies to address
D) detect emerging patterns in crime prevention strategies and develop appropriate responses

Question 13

Evaluation research-sometimes called program evaluation-refers to a research purpose rather than a specific research method. Its special purpose is to evaluate the effects of policies.

Question 14

Evaluation research entails special logistical, ethical, and political problems because it is
Embedded in the day-to-day events of _____. Although some ethical norms have political aspects-for example, not harming subjects relates to protection of civil liberties-no one has developed a set of political norms that can be agreed on by all criminal justice researchers.

A) public policy and real life
B) public policy and law makers' views
C) researchers' views and real life
D) university policy and real life

Question 15

Evaluation research and problem analysis play a significant role in program development and policy making since criminal justice agencies are expected to _____ of their actions. If traditional approaches to probation supervision, for example, do not deter future law-breaking, new approaches should be developed and their effectiveness assessed.

A) justify the feasibility and convenience
B) justify the effectiveness and cost
C) justify the implementation process and cost
D) justify the outcome process and cost

Question 16

Policies are formulated to produce an effect or impact. In this sense, a policy can be
Viewed as a hypothesis in which _____ is expected to produce change in a dependent variable.

A) a dependent variable
B) both dependent and independent variable
C) an independent variable
D) a nominal level variable

Question 17

Outcome measures are not the same as program goals. They are derived from goals, Program goals represent desired outcomes, whereas _____ of whether those desired outcomes are achieved. Identifying program goals and objectives results in a conceptual definition.

A) outcome measures are technical indicators
B) outcome measures are empirical indicators
C) outcome measures are created indicators
D) outcome measures are logistical indicators

Question 18

Random assignment of subjects is often impossible in criminal justice evaluations. Rather than forgo evaluation altogether in such instances, it is usually possible to create and execute research designs that will permit evaluation of the program using quasi-experiments design. Quasi experiments design uses _____ to the experimental and control group.

A) Systematic assignment
B) probability assignment
C) non-random assignment
D) random assignment

Question 19

Policy outputs refer to what is actually produced, in much the same manner that a manufacturer of office supplies produces paper clips and staples. For example, the prosecutor's policy produces the routine review of sentence recommendations in drug cases or a selective traffic enforcement program intended to reduce auto accidents on a particular roadway may produce a _____ together with traffic citations for speeding.

A) undercover police officers
B) presence of unmarked police cars
C) road blocks for police units
D) visible police presence