Exam 17: Tests and Measurements

A given test may be reliable, and yet still not be valid.

When a correlation is established between the odd and even-numbered items, then the procedure was used to assess

For a given administration of the welcome-back-to-school test, the KABC (Kotter Assessment Battery for Children), the mean was 100 with an SD of 15. The test-retest reliability was .90. Find the standard error of measurement.

The Spearman-Brown prophecy formula should not be used unless the correlation has been obtained on the basis of the

If a certain test had a reliability value of .95, then we know that

Find the whole test reliabilities for the following split-half correlations, all of which were calculated on the basis of a sample of 30 persons. a. .63 b. .93 c. .33 d. .78

The split-half method is used to assess a test's construct validity.

If a certain test had a reliability value of 2.95, then we know that

If the proportion of persons answering a given item correctly were to reach 95%, then the item would be assigned

What type of validity procedure was used in this example?

When the internal consistency of a test is being determined on the basis of the Kuder-Richardson formula (KR21), then it should NOT be followed by

One popular statistical technique for evaluating the level of item discrimination is the

A forensic psychologist is attempting to assess the validity of a new test of police aptitude. The test is given to a random sample of first-day trainees during their orientation session at the police academy. At the end of the 2 month training program each subject is evaluated by the academy's director and rank-ordered on the basis of overall proficiency. The data follow. Subj\# Test Score Ranking 1 55 8 2 60 3 3 45 6 4 75 2 5 43 5 6 34 10 7 48 7 8 62 1 9 50 4 10 46 9 -Is this a valid test? . Point out to your students that this is actually a positive correlation as far as the validity is concerned. The only reason the negative sign appears is because in the ranking process, the highest score gets a 1 (a metrically low number) and the lowest score gets a 10 (a metrically higher number). Ask your students to rank order the test scores, and then again compute the Spearman, using only the two sets of ranks. At that point, that correlation of -.733 now has a positive sign.

A psychologist wants to assess the reliability of a new test of Self Control, the higher the scores the higher the level of control. A random sample of college students is selected and given the test. In order to tap the reliability, the test is scored on the basis of comparing the results of the odd items versus the even items. The data follow: Subject\# Odd Even 1 45 57 2 50 48 3 35 57 4 62 55 5 55 60 6 38 50 7 55 50 8 45 38 9 65 70 10 55 50 -What is the correlation between the odd and even items?

A researcher in the area of cognitive functioning has designed a new test of creativity, called the CIA test (Cognitive Information Assessment). A random sample of ten, five-year-old children is selected and given the test. A week later the same test was administered for a second time. Estimate the reliability of this test. Subject \# Test Retest 1 \cdot 30 33 2 \cdot 10 15 3 \cdot 20 18 4 \cdot 18 20 5 . 22 16 6 . 23 21 7 . 17 15 8 \cdot 20 22 9 . 25 28 10 . 15 15

A new test, the NCAA (Number-Concept-Awareness-Ability) is being standardized for college athletes majoring in math, and it has been found to have a mean of 85 and an SD of 15. The test is composed of 125 items. Find its KR21 reliability.

A researcher wishes to estimate the reliability of the FYI (Functional Youth Indicator) - a new test of adolescent shyness. The test is composed of a total of 30 items, and the researcher splits the scoring in order to compare each subject's score on the odd numbered items with those on the even numbered items. A total of 10 teen-age males was randomly selected and their scores were as follows: Odd Even Subject \# 1. 10 9 2. 8 11 3. 12 12 4. 10 9 5. 11 10 6. 9 10 7. 10 9 8. 15 14 9. 5 6 10. 10 10 Estimate the reliability of the whole test.

When engaging in item analysis techniques, the researcher treats each item as

For a given administration of the KISS (Kelly Impulsivity Standards Scale), the mean was 50 with an SD of 10. The test-retest reliability was .85. Find the standard error of measurement.

If a certain test had a reliability value of .95, then its validity must be at least