Deck 8: Designing Effectiveness-Based Information Systems

Question 1

Most software packages for human services allow programs to track which of the following EXCEPT:

A) clients.
B) financial files.
C) qualitative data.
D) performance files.

Answer 1

C

Question 2

Regardless of which computerized systems are used, the manager is confronted with three issues. Which of the following is NOT correct?

A) Who will collect and enter the data?
B) What questions do I need the system to answer?
C) What data elements must be included I the system in order to answer the questions?
D) What Types of regular reports needed for monitoring and evaluation?

Answer 2

A

Question 3

Effectiveness-based program planning requires that data be generated that will accomplish all EXCEPT which of the following:

A) support decision-making in the best interest of the client.
B) what services are most effective with what types of clients.
C) what services are most effective with what types of problems.
D) what new services need to be added.

Answer 3

D

Question 4

A data collection system must be based on the program's logic model. Which of the following statements below is NOT true?

A) The development of goals and objectives is another way of presenting the program hypothesis.
B) The identification and definition of inputs, throughputs, outputs, and outcomes is based on the goals and objectives.
C) The program model is designed before the logic model is developed.
D) Progress toward goals and objectives can be collected and reported.

Question 5

When providing input on the design of data collection, a program planner must consider the ultimate purposes of the system. Which of the following is NOT correct?

A) The evaluation function
B) The capacity of the data collection system
C) Assess the compatibility of evaluation data
D) The program analysis

Question 6

There are five steps involved in designing and implementing a system that assists in understanding of how the components of a logic model relate to each other. Which of the following statements is NOT correct?

A) Consider the evaluation context of data collection and aggregation
B) Identify the data elements needed
C) Develop a strategy for analysis of the data
D) The way in which the assumptions of the logic model impact the evaluation

Question 7

A data collection system assists in formative evaluation during the operation of the program. Which of the following is NOT one of the ways in which formative evaluation data assists in program planning?

A) If the program is on target with the financial management plan
B) Is the program being implemented in accordance with the plan
C) Are the program participants representative of the program's target population
D) Are the services being offered consistent with those that were promised in the program design

Question 8

Five general Types of evaluation can be identified, each capable of providing different information about program functioning. Which of the following is NOT one of those five general types?

A) Evaluation of an effort
B) Evaluation of cost efficiency
C) Evaluation of excellence
D) Evaluation of impact

Question 9

A program hypothesis might be based on the following phrases including "Because there are …" All of the following are correct EXCEPT

A) the result is …
B) the problem will be solved by ….
C) if the following actions are taken …
D) then it is expected that …

Question 10

Data elements provide information about the clients and the program. Which of the following is NOT a part of that process?

A) The client population being served
B) The results being achieved
C) The services being provided
D) The number of units of service

Question 11

The answers below are Program Inputs, EXCEPT which of the following:

A) service tasks.
B) client social history.
C) material resources.
D) client problem/strengths profile.

Question 12

Client Problem/Strengths assessment tools can be designed to determine all EXCEPT which of the following:

A) severity of the problem.
B) area of strengths.
C) reason for seeking service.
D) degree of strengths.

Question 13

"Facilities" is often a data element included in data collection and it is important to be examined for relationships between facilities and other data elements. Which of the following is NOT likely to be examined in relation to facilities?

A) Relationship between facility location and keeping appointments
B) If facilities are improved, will more clients come to the center
C) Do clients make more progress if home visits are included in services
D) Is there any relationship between location and client outcomes

Question 14

Service Tasks are used to define the service process and break it down into a series of stages or phases. Which of the following is an example of a service that could be broken into more precise tasks?

A) intake
B) Exit interview
C) Providing food to a family
D) Counseling

Question 15

Planning for cross-cultural services consider all EXCEPT which of the following:

A) community reaction to specialized services.
B) if there are small groups to be included in the program.
C) do the cross-cultural programs pose barriers to other groups to be served.
D) does the planned intervention need to be adapted or modified for special groups.

Question 16

Intermediate outputs are defined as units of service and can be measured in three of the ways listed below. Which of the following it NOT correct?

A) Time unit
B) Episode
C) A material unit
D) Type of service

Question 17

One approach to data collection is to structure it around program objectives including all EXCEPT which of the following:

A) emerging issues of interest.
B) data elements required.
C) data source.
D) data display and analysis.

Question 18

Tables are one way to show a picture of data in columns and row that can easily be understood. All of following are examples of labels included in a table EXCEPT:

A) data elements.
B) data aggregation.
C) data disaggregation.
D) qualitative data.

Question 19

A table designed to assess program throughputs, outputs, or outcomes might use the following variables. Which variable would likely NOT be used?

A) Number and percent of clients who attended at least 80% of the healthy cooking classes
B) Number and percent of clients who moved from another state
C) Number and percent of clients who had lowered their blood pressure by the end of the program
D) Number and percent demonstrating an increase in knowledge and awareness of domestic violence issues

Question 20

The Commonwealth of Australia has identified five principles in collecting performance information that may be useful in tracking progress. Two of the principles are a focus on outcomes and comprehensiveness. Which of the following is NOT included in the five principles:

A) comparability.
B) timeliness.
C) progressive data availability.
D) conclusions from the data.

Question 21

Management information is underutilized in human services.

Question 22

Dashboards use a series of metrics to track and analyze organizational activity.

Question 23

Dashboards and Scorecards are separate functions in Human service organizations and should not be used together.

Question 24

The role of the program planner is to ensure that the information system will provide the data necessary to manage the organization.

Question 25

In designing management systems, the most important issue is to be sure to select a system that is compatible with existing systems and is easy to operate.

Question 26

Each component of the program processes has implications for data collection.

Question 27

Evaluation of a program, by necessity takes place at the end of a program because the data are collected for the evaluation.

Question 28

An efficient way to generate programmatic questions is to revisit the problem analysis and the working intervention hypothesis.

Question 29

Summative evaluation involves the aggregation of data to show that the service data met the goals and objectives.

Question 30

Defining the method of intervention will help evaluators and program staff to learn whether one particular method of intervention is more effective than others with certain types of clients.

Question 31

_______outputs are defined as service completion.

Question 32

In effectiveness-based program planning, each activity is shaped by the completion of the ________ and, in turn, will shape future activities

Question 33

The program hypothesis will include a series of statements: "Because there are people with this problem …," "The result of the problem is …," "If the following actions are taken …," "then it is ______ that …."

Question 34

Standardized measures or level-of-functioning scales are used to measure changing levels of client __________ and progress.

Question 35

As program planners prepare the evaluation strategy, they are attempting to accomplish two purposes 1) assess the relative success of programs in meeting their stated objectives and 2) to identify potential areas for program _________.

Question 36

Define then compare and contrast formative and summative evaluation. Discuss the ways in which it is utilized in human services.

Question 37

"Final Outcomes are identified and defined by returning to the _______for which the program was created." Discuss how each step in the program planning process from defining the problem through preparing reports flows from the step before.