Deck 12: Becoming Critical Consumers of Evaluations

Question 1

According to the text, the first step in conducting an evaluation is to identify the problem or concern to be evaluated. The problem or concern must be stated clearly and concisely so that readers of an evaluation report can critically consume the study. The text suggests which of the following models for framing how well the author has identified the problem?

A) Post-Modern
B) Experiential
C) Experimental
D) Logic

Answer 1

D

Question 2

In an ideal agency, social work practitioners will be able to apply the most effective interventions for empowering clients and client systems. Unfortunately, there are multiple factors that can interfere with this ideal situation. According to the text, what circumstance(s) can interfere with the implementation of effective interventions?

A) Lack of resources
B) Training limitations
C) Lack of administrative support
D) A & B
E) A, B, & C

Answer 2

E

Question 3

Dana, a first-year graduate student, is reviewing an evaluation report for a substance abuse program. She needs to identify and critique the purpose of the study in order to complete a course assignment. In what section of the report will she most likely find the purpose of the evaluation stated?

A) Research Questions & Hypotheses
B) Research Results
C) Webpage
D) Research Dissemination

Answer 3

A

Question 4

Min's early experiences as a student researcher are similar to those of other social work graduate students. They are required to take at least one research methods courses in every MSW program. Which accrediting body mandates research methods courses for all undergraduate and graduate students of social work?

A) CSWE
B) IFSW
C) NASW
D) ATF

Question 5

As a social worker, Emily is committed to using evidenced-based practices. She believes that social workers have an ethical obligation to implement effective practices and programs. Further, she makes concerted efforts to help her clients understand practice and program evaluations. According to the text, what is a plausible assumption about why clients could critically consume evaluations?

A) Clients are incapable of consuming evaluations
B) Clients focus on meeting treatment objectives and goals
C) Clients will have the most at stake in evaluations
D) None of the above

Question 6

Stefani is involved in critically consuming a research report. She recognizes that understanding the research design of a report can be challenging. Among other things, a critical consumer like Stefani will need to understand the intervention that was used, and how the outcomes are measured. Why is it that such critiques can be challenging for the critical consumer?

A) It requires considerable application knowledge about research designs
B) It requires considerable technical knowledge about research methodologies
C) It requires considerable application knowledge and interpretation methods
D) None of the above

Question 7

In disseminating the evaluation report for an organization, researchers should ensure that stakeholders either have access to or are informed about the results. The use of newsletters, newspaper inserts, and workshops can be effective in communicating the evaluation report. When researchers consider who the stakeholders are, it is important to include which of the following groups that is often overlooked?

A) Those who fund the organization
B) Those who are responsible for the oversight of the organization
C) Those who are responsible for the accreditation of the organizations
D) Those who are clients and family members

Question 8

Social workers are encouraged and sometimes expected to have an understanding of research methods. This knowledge will help practitioners evaluate program and practice evaluations, particularly as it pertains to understanding evidence-based practices. According to the text, why is it important for social workers to critically consume evidence-based practices?

A) Consequences to clients can occur if evaluations are misinterpreted
B) Helps social workers obtain recognition, including promotions
C) Helps social workers build a large referral-base
D) Both C & D

Question 9

After completing a program evaluation, researchers often debate about what strategies to use in disseminating the results. Eventually they decide on several alternatives including an executive summary, informal presentations, and a technical report. Why is it advantageous to use multiple strategies for disseminating an evaluation?

A) Helps with notoriety
B) Stakeholders have varying needs and capacities as critical consumers
C) Helps provide accountability, which is important to most stakeholders
D) Stakeholders have multiple time constraints and benefit from the flexibility

Question 10

A public meeting is planned as a means to allow stakeholders to hear about the results of an evaluation. Unfortunately, the location for the meeting can only accommodate 30 participants. As such, a community organizer suggests that clients not be invited to the meeting; however, this idea is quickly quelled. What stereotypes exist about clients that may keep this group from receiving invitations to the meeting?

A) Clients are viewed as being disinterested in critically consuming research
B) Clients are viewed as being distracting to other attendees
C) Clients are viewed as being incapable of being critical consumers of research
D) None of the above