Deck 8: Validity and Reliability

Question 1

Validity can be assessed by finding the correlation between scores on:

A) a test and some independent, widely accepted measure of that variable
B) one form of a test and another form of that test
C) the even-numbered items on a test and the odd-numbered items on that test
D) two administrations of the same test

Answer 1

a test and some independent, widely accepted measure of that variable

Question 2

A commonsense definition of validity refers to an instrument that:

A) yields consistent results on subsequent applications
B) has been adequately standardized and has norms available
C) measures what it is supposed to measure
D) discriminates adequately among high and low scorers

Answer 2

measures what it is supposed to measure

Question 3

Reliability of measurement is concerned with:

A) systematic errors
B) relevance
C) consistency
D) proven value

Answer 3

consistency

Question 4

An indispensable quality required for a good measuring instrument is that it produce evidence that is:

A) standardized
B) objective
C) valid
D) criterion-referenced

Question 5

The validity of scores on a teacher-made classroom achievement test should be appraised in terms of:

A) its usability and objectivity
B) its relation to the content and objectives of the course
C) the adequacy of its standardization
D) the discrimination and difficulty level of its items

Question 6

The longer the time interval between a prediction and the event to be predicted, the:

A) smaller are the chances of making a good prediction
B) greater are the chances of making a successful prediction
C) fewer the variables there are to be considered
D) smaller the standard error

Question 7

An arithmetic test is given twice within a few days to a student. The highest possible score is 40. He receives a score of 35 the first time and a score of 18 the second time. If similarly varying results are obtained with other students, the test is probably:

A) lacking in relevance
B) not sufficiently comprehensive
C) too difficult
D) unreliable

Question 8

Which of the following statements is correct?

A) An instrument may or may not be valid.
B) Interpretations made from an instrument may or may not be valid.
C) Widely used instruments can be assumed to be valid.
D) Validity is secondary in importance to reliability.

Question 9

Content-related evidence of validity would be provided by:

A) giving a math test on Monday and again on Friday
B) having experts review the test
C) obtaining scores on the even- and odd-numbered items on the test
D) having two scorers independently score the test

Question 10

Construct-related evidence of validity would be provided by:

A) favorable review by experts
B) correlations with other variables as predicted
C) demonstrating that scores are predictably changed by training
D) all of the above

Question 11

Criterion-related evidence of validity would be provided by:

A) comparing scores on an instrument with scores on another instrument given to the same sample
B) giving the instrument again at a later time
C) comparing scores on the instrument with those obtained with another sample
D) giving a second instrument to a second sample

Question 12

Which of the following is not a means of assessing internal consistency?

A) the split-half method
B) test-retest method
C) the Kuder-Richardson method
D) the alpha method

Question 13

Which of the following would be a way of assessing unreliability due to content and time?

A) Administering a reading test (Form X) on Monday and again on Friday
B) Administering a reading test (Form X) on Monday and calculating a split-half correlation
C) Administering a reading test (Form X) on Monday and Form Y on Friday
D) Administering a reading test (Form X) on Monday and calculating alpha

Question 14

Which of the following is a way to assess the predictive validity of an algebra test?

A) Correlate test scores with teacher ratings in algebra
B) Correlate test scores with success as an engineer
C) Correlate test scores with algebra grades
D) Correlate test scores with scores on algebra homework assignments

Question 15

Which of the following would be considered evidence of validity of observer ratings of social adjustment?

A) A correlation of .80 between two observers
B) A correlation of .50 with peer nominations for class president
C) A correlation of .10 with a test of social adjustment
D) A correlation of .70 with a test of mechanical aptitude

Question 16

Determining split-half reliability requires that:

A) each student's test be scored twice
B) some students be given half the items, others the remainder
C) half the students be given Form A, the rest Form B
D) each student be tested twice

Question 17

Which of the following items logically measures "respect for differing cultures"?

A) Asian Americans should have to pay taxes Agree Disagree
B) Asian Americans contributed to building our railroads Agree Disagree
C) Asian Americans should be required to speak English only Agree Disagree
D) Asian Americans should be required to attend school Agree Disagree

Question 18

Which of the following would be considered evidence of validity for a test of "hostility"?

A) A correlation of .10 with teacher ratings of hostile behavior
B) A much higher average score following a frustrating experience
C) A retest correlation of .50
D) A correlation of .70 with GPA

Question 19

Criterion-related evidence of validity can be shown by:

A) the alpha coefficient
B) the expectancy table
C) the Spearman-Brown formula
D) all of the above

Question 20

Errors of measurement are caused by:

A) changes in test items
B) changes in the people who take a test
C) changes in the administration of the instrument
D) all of the above

Question 21

Matching

-Errors of measurement

A) Validity.
B) Reliability.
C) Reliability
D) Reliability .
E) Validity

Question 22

Matching

-Construct-related evidence

A) Validity.
B) Reliability.
C) Reliability .
D) Reliability
E) Validity

Question 23

Matching

-Internal consistency

A) Validity.
B) Reliability.
C) Reliability .
D) Reliability
E) Validity

Question 24

Matching

-Expectancy table

A) Validity.
B) Reliability.
C) Reliability .
D) Reliability
E) Validity

Question 25

Matching

-Test-retest

A) Validity.
B) Reliability.
C) Reliability .
D) Reliability
E) Validity

Question 26

Content-related evidence of validity includes questions about the format of an instrument.

Question 27

To obtain evidence of predictive validity, researchers gather instrument data and criterion data without allowing much time to elapse.

Question 28

The equivalent forms method yields a reliability coefficient.

Question 29

Instruments that use direct observation are highly vulnerable to observer differences in scoring.

Question 30

Validity and reliability are not applicable to qualitative resear