Exam 4: Reliability and Validity

When a test measures what it was designed to measure and what it purports to measure, this test is said to be reliable.

What are the three types of reliability? What are the optimal reliability scores?

Using the graph below, answer the questions that follow. -Given the general flow of the direction of the data, these variables are likely to be which of the following?

Educator is concerned with item reliability; items are scored as right and wrong.

One would expect that the number of classes a college student attends in a specific course and the final exam grade in that course would have a ___.

A teacher who administers a wide range achievement test in reading (i.e., WRAT) is able to take the score obtained and generalize it across all of the individual domains and skills associated with reading.

A new test was designed to measure the self-concept of students of middle school age. The test required students to use essay-type responses to answer three questions regarding their feelings about their own self-concept. Two assessment professionals were comparing the students' responses and how these responses were scored by the professionals. On this type of instrument, it is important that the ___ is acceptable.

The scores obtained by Dr. Smith on a psychology test were compared and it was determined that students who scored high on the first exam tended to score high on the second exam. Which of the following represents the probable correlation between the two sets of scores?

What type of reliability is reported in Table 4.1?

Standard error of measurement is used to determine confidence intervals.

Look at the reliability reported for age 7. Using fall statistics, compare the reliability coefficient obtained on the Numeration subtest with the reliability coefficient obtained on the Estimation subtest. On which subtest did seven-year-olds perform with more consistency?

Measures of internal consistency are used to determine which of the following?

Discuss the reasons why interrater reliability is important on assessment devices that have open-ended questions, such as essay exams.

A college student failed the first test of the new semester. The student hoped that the first test did not have strong ___ about performance on the final exam.

A range of possible scores can then be determined by using the ___ for the specific test.

The larger the standard error of measurement, the less ___ the test.

Establishing interrater reliability is especially important when test data are which of the following?

How would the use of standard error of measurement help in making educational decisions for students?

A test instrument may have good reliability; however, that does not guarantee that the test has ___.

Educator is concerned with item consistency; items scored with different point values for correct responses.