Deck 22: Program Evaluation: Applying Science and Practice to Real Life

Question 1

Data obtained through _____, which are a form of content testing, are useful when distinct facts or information is being conveyed through a counseling program.

A) self-report logs
B) journals
C) course exams
D) satisfaction surveys

Answer 1

C

Question 2

Moving back and forth from a counseling program's objectives to its evidence and the weaving together of the individual pieces of data into a holistic picture is:

A) the core process of program evaluation.
B) the triangulation of the data.
C) the primary step of program evaluation.
D) the cause of attenuation in evaluation results.

Answer 2

A

Question 3

During the initial meetings and throughout the evaluation process, it is important for a program evaluator to recognize and control the urge to listen to his or her intuition.

Answer 3

False

Question 4

A program evaluator's responsibility is to determine if there is a match among the counseling treatment, the anticipated outcomes, and the outcome measures.

Question 5

It is a responsibility of a program evaluator to ensure that the concerns raised at meetings represent not just the opinions of the vocal, but also those of potentially underrepresented stakeholders of a counseling program.

Question 6

It is mandatory for all counseling students to be trained in the practice of program evaluation.

Question 7

Program evaluation is often described as a process for judging the worth of a counseling program relative to other alternatives, based on defensible, previously defined criteria.

Question 8

Which of the following is the most common way to determine whether a counseling program took place and the form it took during implementation?

A) Post-research analysis
B) Observational methodology
C) Qualitative data analysis
D) Quantitative research

Question 9

There are eight distinct phases of program evaluation that an evaluator needs to follow, applicable at any stage of a counseling program.

Question 10

Even though structured observations and participant observations provide two different data sets, it is common to use both observation methods simultaneously in counseling research.

Question 11

Under the second phase of program evaluation, which of the following is a step in creating a focused program evaluation?

A) Determining the purposes of the program evaluation
B) Creating a consolidated data collection plan to assess progress
C) Collecting background information about the program
D) Making a preliminary agreement regarding the evaluation

Question 12

As a guide to program evaluation, which of the following is the rationale behind the key question "What role will the program evaluator play?"

A) A very small project can be prevented from having a far too expansive evaluation, and vice versa.
B) Knowledge of the program objectives is essential in order to link what the program was designed to accomplish.
C) An evaluator can help shape the evaluation, the time line, and the types of statistics used in the program analyses.
D) Knowing what a program manager feels comfortable with in terms of evaluator exposure helps in planning an evaluation.

Question 13

Getting stakeholders actively involved in the process of program evaluation is one of the most counterintuitive steps of evaluation.

Question 14

The final step in conducting a counseling program evaluation involves:

A) reviewing literature and documenting useful citations.
B) creating an evaluation trail and conducting a metaevaluation.
C) obtaining evidence that supports or refutes a claim of the program.
D) calculating subscores and frequencies for each item in an evaluation.

Question 15

In the context of program evaluation and research, evaluators are responsible for:

A) setting the boundaries of an evaluation.
B) selecting participants for a research study.
C) utilizing the evaluation methods defined by the program developer.
D) providing all of the raw data to the program participants.

Question 16

Which of the following questions is asked as part of the fifth step under phase two of counseling program evaluation?

A) How are differing points of view dealt with in a program group?
B) What aspects of the program need to be evaluated?
C) What statistical analysis will be performed on the collected data?
D) At what point in the program will the evaluation begin?

Question 17

In the context of data collection for a counseling program, focus group methodology relies on the interaction of people as they discuss a common experience or viewpoint.

Question 18

Which of the following is ideally the next immediate phase of program evaluation after setting the boundaries of the evaluation?

A) Identifying stakeholders and funders
B) Reporting the research findings
C) Selecting appropriate evaluation methods
D) Collecting and analyzing research data

Question 19

In the context of counseling programs, which of the following is a difference between structured observations and participant observations?

A) Structured observations capture the quantity of activities that have occurred, whereas participant observations describe the mood during activities.
B) Unlike structured observations, participant observations are highly organized and more quantitative.
C) Structured observations occur at the start of an activity, whereas participant observations occur at the end of an activity.
D) Unlike structured observations, participant observations monitor how presenters provide information during 25-minute segments.

Question 20

Program evaluators ideally want to be involved while counseling programs are being designed.