Deck 4: Validity
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Question
Unlock Deck
Sign up to unlock the cards in this deck!
Unlock Deck
Unlock Deck
1/33
Play
Full screen (f)
Deck 4: Validity
1
_____________ is a statistical technique used to determine how well items mathematically group together,thus indicating similarity and the measurement of a common construct.
A)Item analysis
B)Validity coefficient
C)Content validity ratio
D)Factor analysis
A)Item analysis
B)Validity coefficient
C)Content validity ratio
D)Factor analysis
D
2
What was a major change between the third and fourth editions of the Standards for Educational and Psychological Testing,as it relates to validity?
A)The fourth edition included a tripartite view of validity
B)The fourth edition included a unified view of validity
C)The fourth edition emphasized scientific rigor when investigating validity
D)The fourth edition eliminated discussion of validity
A)The fourth edition included a tripartite view of validity
B)The fourth edition included a unified view of validity
C)The fourth edition emphasized scientific rigor when investigating validity
D)The fourth edition eliminated discussion of validity
B
3
What is face validity?
A)An assessment of whether the instrument appears to look like it measures what is meant to measure
B)An assessment of whether the instrument measures what it is intended to measure
C)An assessment of whether the instrument later predicts an outcome
D)An assessment of whether the instrument has established reliability
A)An assessment of whether the instrument appears to look like it measures what is meant to measure
B)An assessment of whether the instrument measures what it is intended to measure
C)An assessment of whether the instrument later predicts an outcome
D)An assessment of whether the instrument has established reliability
A
4
Validity speaks to the ___________ of data.
A)Accuracy
B)Reliability
C)Truthfulness
D)Conciseness
A)Accuracy
B)Reliability
C)Truthfulness
D)Conciseness
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
5
Validity refers to:
A)The instrument being used
B)The test administrator
C)The test taker
D)The application of an instrument
A)The instrument being used
B)The test administrator
C)The test taker
D)The application of an instrument
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
6
What term is commonly used to refer to the entire body of accumulated validity evidence about a test or assessment?
A)Content validity
B)Criterion validity
C)Construct validity
D)Discriminant validity
A)Content validity
B)Criterion validity
C)Construct validity
D)Discriminant validity
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
7
Which of the following is not one of the three primary types of validity?
A)Generalized validity
B)Construct validity
C)Criterion validity
D)Content validity
A)Generalized validity
B)Construct validity
C)Criterion validity
D)Content validity
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
8
What is the purpose of group differentiation when assessing for construct validity?
A)To determine whether a test can differentiate two different groups of people in a way predicted by theory
B)To determine if scores on a test are found to be uncorrelated to scores on another instrument measuring a different construct
C)To produce a statistical coefficient
D)None of the above
A)To determine whether a test can differentiate two different groups of people in a way predicted by theory
B)To determine if scores on a test are found to be uncorrelated to scores on another instrument measuring a different construct
C)To produce a statistical coefficient
D)None of the above
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
9
Why is construct validity said to be a difficult type of validity evidence to collect?
A)Statistical analyses to examine this type of validity are complex
B)The amount of items needed on the measure is very large
C)It is often obvious to the test taker what the measure is evaluating
D)Defining the construct and accurate measurement are difficult to achieve
A)Statistical analyses to examine this type of validity are complex
B)The amount of items needed on the measure is very large
C)It is often obvious to the test taker what the measure is evaluating
D)Defining the construct and accurate measurement are difficult to achieve
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
10
"The degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests" is the definition of
A)Reliability
B)Validity
C)Accountability
D)Accuracy
A)Reliability
B)Validity
C)Accountability
D)Accuracy
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
11
The GRE is designed to predict future performance in graduate school.If GRE scores are compared to students grade point average in graduate school,then the grade point average is the:
A)Construct measure
B)Content measure
C)Criterion measure
D)Predictor measure
A)Construct measure
B)Content measure
C)Criterion measure
D)Predictor measure
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
12
What is the purpose of an item analysis when assessing for construct validity?
A)To determine if items on the tests are measuring the same construct
B)To determine if there is enough heterogeneity of items in the instrument
C)To determine if items accurately predict the criterion
D)To determine if items on one instrument are consistent with other instruments measuring the same construct
A)To determine if items on the tests are measuring the same construct
B)To determine if there is enough heterogeneity of items in the instrument
C)To determine if items accurately predict the criterion
D)To determine if items on one instrument are consistent with other instruments measuring the same construct
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
13
Why is important that a well-established construct is used when examining content validity of a measure?
A)It determines what is assessed and what items are included on the measure
B)It makes it clearer whether the measure is reliable
C)A content validity ratio can be conducted
D)Establishing a clear construct is not necessary
A)It determines what is assessed and what items are included on the measure
B)It makes it clearer whether the measure is reliable
C)A content validity ratio can be conducted
D)Establishing a clear construct is not necessary
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
14
Validity estimates are often expressed in terms of:
A)Degree to which validity is present
B)Whether or not validity is present
C)Likelihood of validity present
D)Amount of validity error present
A)Degree to which validity is present
B)Whether or not validity is present
C)Likelihood of validity present
D)Amount of validity error present
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
15
If a researcher is setting out to answer the question "how well did the developers of the instrument select items that represented the given construct?",what type of validity is the researcher evaluating?
A)Criterion validity
B)Content validity
C)Face validity
D)Concise validity
A)Criterion validity
B)Content validity
C)Face validity
D)Concise validity
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
16
What is the simplest approach to assess content validity of an instrument?
A)Content validity ratio
B)Split-half reliability
C)Panel of experts
D)Feedback from test takers
A)Content validity ratio
B)Split-half reliability
C)Panel of experts
D)Feedback from test takers
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
17
True or False: Reliability is a necessary but not a sufficient condition for validity.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
18
What does a positive content validity ratio indicate?
A)The item is not essential to the construct being measured
B)The item is essential to the construct being measured
C)The item is neutral to the construct being measured
D)There are no relationships between the items being measured
A)The item is not essential to the construct being measured
B)The item is essential to the construct being measured
C)The item is neutral to the construct being measured
D)There are no relationships between the items being measured
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
19
If scores on a new memory scale for children are similar to scores on other well-validated memory scales,it might be concluded that the new memory scale has:
A)Discriminant validity
B)Divergent validity
C)Convergent validity
D)Face validity
A)Discriminant validity
B)Divergent validity
C)Convergent validity
D)Face validity
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
20
In terms of validity,if a researcher illustrated that scores on an instrument changed as the test takers aged,this would be an example of:
A)Factor analysis
B)Development change
C)Group differentiation
D)Longitudinal evaluation
A)Factor analysis
B)Development change
C)Group differentiation
D)Longitudinal evaluation
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
21
Describe the method for establishing evidence of content validity
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
22
Describe the methods of assessing for construct validity.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
23
The _____________ the validity coefficient,the more valid the use of the assessment test or procedure.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
24
______________ is the ratio of the number of raters who evaluate an item and the number of raters who deem an item to be an essential component of the construct being measured.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
25
Two factor analytic methods include _____________ and ____________.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
26
What are the guidelines for interpreting validity coefficients?
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
27
When a test score and criterion performance measure are collected at approximately the same time,__________ validity can be assessed.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
28
____________ validity is the most difficult type of validity evidence to collect.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
29
______________ occurs when the previous knowledge influences the gathering of criterion data.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
30
What are characteristics of a sound criterion?
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
31
Why is validity important for counselors?
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
32
The ___________ the content validity ratio value,the better the item is at assessing an essential component of the construct of interest.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck
33
________ and ________ the criterion performance score will be collected is important when choosing which criterion-related validity approach to use.
Unlock Deck
Unlock for access to all 33 flashcards in this deck.
Unlock Deck
k this deck