Deck 11: Critically Appraising and Selecting Assessment Instruments

Full screen (f)
exit full mode
Question
For an instrument to be reliable:

A) it must be valid.
B) an individual's responses to it must be consistent.
C) it must be sensitive.
D) All of the above.
Use Space or
up arrow
down arrow
to flip the card.
Question
Internal consistency reliability requires:

A) internal validity.
B) stability in responses over time.
C) positive correlations among the items of an instrument.
D) All of the above.
Question
Coefficient alpha refers to:

A) the statistical significance of an instrument.
B) the stability of an instrument.
C) interrater reliability.
D) the mean of all those split-half correlations of scale items.
Question
Test-retest reliability:

A) is more expedient and less costly to assess than internal consistency reliability.
B) involves testing people with the same instrument at least 6 months between test and retest.
C) is affected by the possibility that some people might really change between test and retest.
D) All of the above.
Question
Validity:

A) requires reliability.
B) refers to whether an instrument really measures what it is intended to measure.
C) Both a and b.
D) None of the above.
Question
Face validity:

A) is the strongest form of validity.
B) is the weakest form of validity.
C) is a form of criterion validity.
D) None of the above.
Question
Criterion validity:

A) can be in the form of predictive validity.
B) can be in the form of concurrent validity.
C) can be in the form of known-groups validity.
D) All of the above.
Question
Construct validity:

A) involves assessing convergent validity.
B) involves ruling out alternative constructs via assessing discriminant validity
C) might involve assessing factorial validity
D) All of the above.
Question
If an instrument has linguistic equivalence across two different cultures, it will:

A) have conceptual equivalence.
B) have metric equivalence.
C) be reliable and valid in both cultures.
D) All of the above.
E) None of the above
Question
If an instrument is reliable, then it is also valid.
Question
An instrument is reliable if responses to it are consistent.
Question
To have internal consistency reliability, an instrument's coefficient alpha should be less than .05.
Question
Test-retest reliability is particularly relevant if an instrument is to be used to monitor treatment progress.
Question
Interrater reliability requires that each rater give exactly the same rating to each observed behavior.
Question
Face validity requires no evidence that an instrument is really valid; it just means that in somebody's judgment the items seem to tap the concept in question.
Question
To have content validity, a group of experts must agree that the items on an instrument adequately cover the full domain of the concept that the instrument intends to measure
Question
Because some instruments might measure a related construct more accurately than the intended construct, some instruments can have criterion validity without having construct validity.
Question
One question to ask when choosing an assessment instrument is whether the instrument is sensitive to relatively small, but important changes.
Question
A good translation of an instrument into another language assures conceptual equivalence.
Question
The length and complexity of an instrument may make it infeasible to use even with adult clients who read well and are not too impaired to complete it.
Question
It's better to use an instrument with excellent validity results derived from a sample of people unlike the ones in your practice than to use an instrument with only adequate validity results derived from a sample of people very much like the ones in your practice.
Question
Define measurement reliability and describe three main approaches for measuring it.
Question
Define measurement validity and describe its various forms.
Question
Define measurement sensitivity and explain its importance in EBP.
Question
Discuss the importance of cultural sensitivity in measurement, and describe three forms of cross-cultural measurement equivalence.
Question
Discuss the factors to ponder when considering the feasibility of a measurement instrument.
Question
Discuss the importance of sample characteristics when considering the applicability of a measurement instrument to a specific EBP situation.
Unlock Deck
Sign up to unlock the cards in this deck!
Unlock Deck
Unlock Deck
1/27
auto play flashcards
Play
simple tutorial
Full screen (f)
exit full mode
Deck 11: Critically Appraising and Selecting Assessment Instruments
1
For an instrument to be reliable:

A) it must be valid.
B) an individual's responses to it must be consistent.
C) it must be sensitive.
D) All of the above.
B
2
Internal consistency reliability requires:

A) internal validity.
B) stability in responses over time.
C) positive correlations among the items of an instrument.
D) All of the above.
C
3
Coefficient alpha refers to:

A) the statistical significance of an instrument.
B) the stability of an instrument.
C) interrater reliability.
D) the mean of all those split-half correlations of scale items.
D
4
Test-retest reliability:

A) is more expedient and less costly to assess than internal consistency reliability.
B) involves testing people with the same instrument at least 6 months between test and retest.
C) is affected by the possibility that some people might really change between test and retest.
D) All of the above.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
5
Validity:

A) requires reliability.
B) refers to whether an instrument really measures what it is intended to measure.
C) Both a and b.
D) None of the above.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
6
Face validity:

A) is the strongest form of validity.
B) is the weakest form of validity.
C) is a form of criterion validity.
D) None of the above.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
7
Criterion validity:

A) can be in the form of predictive validity.
B) can be in the form of concurrent validity.
C) can be in the form of known-groups validity.
D) All of the above.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
8
Construct validity:

A) involves assessing convergent validity.
B) involves ruling out alternative constructs via assessing discriminant validity
C) might involve assessing factorial validity
D) All of the above.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
9
If an instrument has linguistic equivalence across two different cultures, it will:

A) have conceptual equivalence.
B) have metric equivalence.
C) be reliable and valid in both cultures.
D) All of the above.
E) None of the above
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
10
If an instrument is reliable, then it is also valid.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
11
An instrument is reliable if responses to it are consistent.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
12
To have internal consistency reliability, an instrument's coefficient alpha should be less than .05.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
13
Test-retest reliability is particularly relevant if an instrument is to be used to monitor treatment progress.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
14
Interrater reliability requires that each rater give exactly the same rating to each observed behavior.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
15
Face validity requires no evidence that an instrument is really valid; it just means that in somebody's judgment the items seem to tap the concept in question.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
16
To have content validity, a group of experts must agree that the items on an instrument adequately cover the full domain of the concept that the instrument intends to measure
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
17
Because some instruments might measure a related construct more accurately than the intended construct, some instruments can have criterion validity without having construct validity.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
18
One question to ask when choosing an assessment instrument is whether the instrument is sensitive to relatively small, but important changes.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
19
A good translation of an instrument into another language assures conceptual equivalence.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
20
The length and complexity of an instrument may make it infeasible to use even with adult clients who read well and are not too impaired to complete it.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
21
It's better to use an instrument with excellent validity results derived from a sample of people unlike the ones in your practice than to use an instrument with only adequate validity results derived from a sample of people very much like the ones in your practice.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
22
Define measurement reliability and describe three main approaches for measuring it.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
23
Define measurement validity and describe its various forms.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
24
Define measurement sensitivity and explain its importance in EBP.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
25
Discuss the importance of cultural sensitivity in measurement, and describe three forms of cross-cultural measurement equivalence.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
26
Discuss the factors to ponder when considering the feasibility of a measurement instrument.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
27
Discuss the importance of sample characteristics when considering the applicability of a measurement instrument to a specific EBP situation.
Unlock Deck
Unlock for access to all 27 flashcards in this deck.
Unlock Deck
k this deck
locked card icon
Unlock Deck
Unlock for access to all 27 flashcards in this deck.