Deck 11: Policy Analysis and Evaluation Research

Question 1

Which of the following is an international research organization founded in 2000 and dedicated to preparing,maintaining,and publicizing systematic reviews of research on the effects of social and education programs and interventions?

A)Orion Organization
B)Campbell Collaboration
C)Guttman Group
D)Altman Association

Answer 1

B

Question 2

Which of the following is a research branch of the U.S.Justice Department with a mission to develop knowledge about crime,its causes,and control?

A)NSA
B)TSA
C)AIG
D)NIJ

Answer 2

D

Question 3

Which of the following systems model components is defined as what is done in the project with these inputs resources),for example,services provided,staffing patterns,and use of materials and human and physical resources called process in many models)?

A)Inputs
B)Activities
C)Results
D)Feedback

Answer 3

B

Question 4

Which of the following is the last stage of the policy process where questions such as 'do the programs work' are asked?

A)Survey
B)Assessment
C)Conclusion
D)Evaluation

Question 5

Which of the following refers to an applied branch of social science that is intended to supply scientifically valid information with which to guide public policy?

A)Policy research
B)Evaluation research
C)Government research
D)Social science research

Question 6

Which of the following refers to applied field experiments that are addressed to immediate,practical policy questions?

A)Policy research
B)Evaluation research
C)Policy experiments
D)AFE

Question 7

Which of the following assesses whether a program is evaluable?

A)Evaluability assessment
B)Review assessment
C)CRM assessment
D)None of the above

Question 8

Which of the following did the National Research Council's Committee on Research on Law Enforcement and the Administration of Justice identify as steps in designing policy experiments?

A)Choose an interesting problem-a policy question that people really care about or an existing procedure that clearly needs improvement.
B)Do some creative thinking to solve legal and ethical issues that may arise.
C)Rigorously maintain the random assignment of persons,cases,or other units into treatment and control groups throughout the experiment.
D)All of the above

Question 9

Which of the following refers to the examination of relationship between outcome and input,activities and results of a program?

A)Impact evaluation
B)Assessment
C)Process evaluation
D)Monitoring

Question 10

Which of the following is similar to auditing;assessment of whether a program is doing what it is supposed to be doing in terms of process or program activities?

A)Impact evaluation
B)Assessment
C)Process evaluation
D)Monitoring

Question 11

Which of the following refers to the enumeration of the need for an activity or resource.

A)Impact evaluation
B)Assessment
C)Process evaluation
D)Monitoring

Question 12

Which of the following systems model components is defined as specific consequences of the project activities or the specific objectives of the program,for example,amount of services provided,work completed,production accomplished,or cases closed or cleared called output or products in many models)?

A)Inputs
B)Activities
C)Results
D)Feedback

Question 13

Which of the following systems model components is defined as a recycling of results/outcomes into the operation as additional or modified)inputs;profits may induce a corporation to reinvest in a particularly profitable line,just as losses may lead it to eliminate a less profitable line?

A)Inputs
B)Activities
C)Results
D)Feedback

Question 14

Which of the following refers to a model in which all parts of an organism,organization,or program are interrelated and consist of a series of inputs and outputs?

A)Systems model
B)Comprehensive model
C)Symbiotic model
D)Interconnected model

Question 15

Which of the following were identified as dangerous pitfalls by NCJRS?

A)Poorly done evaluation design and methodology
B)Unsound and/or poorly done data analysis
C)Unethical evaluations
D)All of the above

Question 16

Which of the following is the study of the causes and consequences of government behavior what governments do or do not do)?

A)Civil analysis
B)Civil oversight
C)Government oversight
D)Policy analysis

Question 17

Which of the following can be defined as measurement of the effects of a program in terms of its specific goals,outcomes,or particular program criteria?

A)Policy research
B)Evaluation research
C)Evaluation assessment
D)Policy assessment

Question 18

Which of the following refers to the establishment of relationships between results and project inputs and activities?

A)Impact evaluation
B)Assessment
C)Process evaluation
D)Monitoring

Question 19

Which of the following are steps in evaluation research?

A)Problem formulation
B)Design of instruments
C)Research design
D)All of the above

Question 20

Which of the following systems model components is defined as resources,guidelines,rules,and operating procedures provided for a program,for example,funds for personnel,equipment,operating costs,and authorization to introduce new policies often an experimental treatment)?

A)Inputs
B)Activities
C)Results
D)Feedback

Question 21

The outcomes component of the systems model is the accomplishments of broader-range societal goals;these are general consequences of the specific accomplishments outputs/results)of the program,for example,better justice,health,safety,and education.

Question 22

The input component of the systems model is defined as the recycling of results/outcomes into the operation as additional or modified)inputs;profits may induce a corporation to reinvest in a particularly profitable line,just as losses may lead it to eliminate a less profitable line.

Question 23

Which of the following refers to the selection,identification,and specification of the research topic to be investigated?

A)Problem formulation
B)Utilization
C)Design of instruments
D)Findings and conclusions

Question 24

Impact evaluation establishes causal relationships between outcomes such as crime reduction)and inputs,activities,and results of programs.

Question 25

Evaluation research can be defined as measurement of the effects of a program in terms of its specific goals,outcomes,or particular program criteria.

Question 26

Model in which all parts of an organism,organization,or program are interrelated and consist of a series of inputs and outputs.

Question 27

Before an evaluation is undertaken,three crucial questions must be answered: Will the findings be used? Is the project evaluable? Who can do this work?

Question 28

The NIJ is a research branch of the U.S.Department of Justice.

Question 29

Assessment sometimes called needs assessment)is the enumeration of some activity or resource,for instance,the need for a particular service in some target area.

Question 30

The Campbell Collaboration C2)is an international research organization founded in 2000 and dedicated to preparing,maintaining,and publicizing systematic reviews of research on the effects of social and educational programs and interventions.

Question 31

Evaluation research analysis is the "study of whatever governments choose to do or not to do," "the description and explanation of the causes and consequences of government behavior".

Question 32

Policy experiments are applied field experiments that address themselves to immediate practical policy questions.

Question 33

Which of the following are obstacles in evaluation research?

A)Data collection
B)Adequate funding
C)Lack of research topics
D)All of the above

Question 34

Process evaluation establishes causal relationships between results such as an increase in arrests)and project inputs and activities.

Question 35

Evaluability assessment is the process whereby researchers determine if adequate funding is available to complete the research project.

Question 36

The results component of the systems model is the specific consequences of the project activities or the specific objectives of the program,for example,amount of services provided,work completed,production accomplished,or cases closed or cleared called output or products in many models).

Question 37

The activities component of the systems model is defined as what is done in the project with these inputs resources),for example,services provided,staffing patterns,and use of materials and human and physical resources called process in many models).

Question 38

Observing is similar to auditing;assessment of whether a program is doing what it is supposed to be doing in terms of process or program activities.

Question 39

Which of the following is a means of controlling for invalidity in research through experimental design.

A)Problem formulation
B)Utilization
C)Research designs
D)Findings and conclusions

Question 40

Policy analysis is an applied branch of social science that is intended to supply scientifically valid information with which to guide public policy.

Question 41

Before an __________ is undertaken,three crucial questions must be answered: Will the findings be used? Is the project evaluable? Who can do this work?

Question 42

__________ establishes causal relationships between results such as an increase in arrests)and project inputs and activities.

Question 43

A __________ assumes that all parts of an organism,organization,or program are interrelated and could be represented in basic computer language as a system of inputs into an existing system,processing of these

Question 44

The __________ is a research branch of the U.S.Department of Justice.

Question 45

The steps in policy analysis are problem formulation,design of instruments,research design evaluation model),data collection,data analysis,findings and conclusions,and utilization.

Question 46

__________ sometimes called needs assessment)is the enumeration of some activity or resource,for instance,the need for a particular service in some target area.

Question 47

The National Advisory Committee on Criminal Justice Standards and Goals 1976)suggests clear agreements beforehand,assistance from funding agencies in bringing the two parties to suitable agreements,and training programs to acquaint researchers with agency problems and needs.

Question 48

Define evaluation research and identify and discuss the types of questions that are asked during evaluation research;the last stage of the policy process.

Question 49

__________ is the "study of whatever governments choose to do or not to do," "the description and explanation of the causes and consequences of government behavior".

Question 50

__________ are applied field experiments that address themselves to immediate practical policy questions.

Question 51

__________ is an applied branch of social science that is intended to supply scientifically valid information with which to guide public policy.

Question 52

__________ has an applied quality to it that requires the active support and cooperation of the agency or program to be evaluated.

Question 53

Identify and discuss the steps in designing policy experiments as summarized by the National Research Council's Committee on Research on Law Enforcement and the Administration of Justice.

Question 54

__________ is the assessment of whether a program is evaluable.

Question 55

The __________ is an international research organization founded in 2000 and dedicated to preparing,maintaining,and publicizing systematic reviews of research on the effects of social and educational programs and interventions.

Question 56

__________ establishes causal relationships between outcomes such as crime reduction)and inputs,activities,and results of programs.

Question 57

__________ is assessment of whether the plans for a project have in fact been realized: Are the activities related to the inputs?

Question 58

The steps in __________ are problem formulation,design of instruments,research design evaluation model),data collection,data analysis,findings and conclusions,and utilization.

Question 59

The _________ suggests clear agreements beforehand,assistance from funding agencies in bringing the two parties to suitable agreements,and training programs to acquaint researchers with agency problems and needs.

Question 60

Obstacles or pitfalls to evaluation research include poor evaluation design and methodology,poor data analysis,unethical evaluations,naive or unprepared evaluation staff,poor relationships between evaluation and program staff,co-optation of evaluation staff and/or design,poor-quality data,poor literature reviews,and focus on method rather than process.

Question 61

Identify and prioritize your opinion)the recent research priorities of NIJ.Be prepared to discuss your prioritized list.

Question 62

Identify and discuss the pitfalls or obstacles to evaluation research as stated in the text.

Question 63

Identify and define the systems model project components.