Question 1

Which of the following would represent discriminant evidence for the score validity of a test of numerical aptitude?

Accepted Answer

A)  The test has a high correlation with grades in math. 
B)  The test has a low correlation with grades in math. 
C)  The test has a high correlation with reading comprehension. 
D)  The test has a low correlation with reading comprehension. 
A)  The test has a high correlation with grades in math. 
B)  The test has a low correlation with grades in math. 
C)  The test has a high correlation with reading comprehension. 
D)  The test has a low correlation with reading comprehension.

Question 2

The textbook defines test reliability as the ratio between the variance of the

Accepted Answer

A)  error scores and true scores. 
B)  true scores and observed scores. 
C)  error scores and observed scores. 
D)  two sets of scores from identical or equivalent tests. 
A)  error scores and true scores. 
B)  true scores and observed scores. 
C)  error scores and observed scores. 
D)  two sets of scores from identical or equivalent tests.

Question 3

Evidence based on test-criterion relationships may vary from time to time and place to place.Researchers attribute this lack of agreement in validity studies to the

Accepted Answer

A)  type of criterion used. 
B)  type of test taker. 
C)  way the predictor is measured. 
D)  period of time involved. 
E)  All of these are true. 
A)  type of criterion used. 
B)  type of test taker. 
C)  way the predictor is measured. 
D)  period of time involved. 
E)  All of these are true.

Question 4

Other things being equal, would the following practices increase or decrease score reliability?
a.The teacher decided to give a short quiz instead of the usual chapter test.
b.The teacher added five easy test items that everyone could answer correctly.
c.The teacher included 20 spelling words instead of 10 words on the spelling test.

Accepted Answer

a.Decrease

Question 5

You are considering two tests to be used for selection into a class for gifted students.Test A has a mean of 85, standard deviation of 10, and a score reliability of .91.Test B has a mean of 85, standard deviation of 8, and a score reliability of .75.On which test would a student's score be expected to fluctuate more on repeated administrations?

Accepted Answer

A)  Test A 
B)  Test B 
A)  Test A 
B)  Test B

Question 6

A test has a reliability coefficient of .75.This coefficient indicates that

Accepted Answer

A)  56 percent of the variance in scores is true variance. 
B)  75 percent of the variance in scores is true variance. 
C)  25 percent of the variance in scores is true variance. 
D)  75 percent of the test items are valid. 
A)  56 percent of the variance in scores is true variance. 
B)  75 percent of the variance in scores is true variance. 
C)  25 percent of the variance in scores is true variance. 
D)  75 percent of the test items are valid.

Question 7

The Kuder-Richardson 21 formula for estimating the score reliability of a classroom achievement test has the disadvantage that

Accepted Answer

A)  it is difficult to compute. 
B)  it assumes that all test items are of equal difficulty. 
C)  it is inappropriate for a power test. 
D)  the resulting reliability coefficient must be adjusted by using another formula. 
A)  it is difficult to compute. 
B)  it assumes that all test items are of equal difficulty. 
C)  it is inappropriate for a power test. 
D)  the resulting reliability coefficient must be adjusted by using another formula.

Question 8

Exhibit 9-5: Choose the method of estimating score reliability that would be most useful for each of the types of tests listed below.
-Refer to Exhibit 9-5.A classroom achievement test used for grading purposes

Accepted Answer

A)  equivalent forms 
B)  split-half 
C)  test-retest 
A)  equivalent forms 
B)  split-half 
C)  test-retest

Question 9

Exhibit 9-4: Following is a list of testing practices.Assuming other things are equal, indicate whether the practice would lower reliability, raise reliability, or neither.
-Refer to Exhibit 9-4.Removing ambiguous items from the test

Accepted Answer

A)  lower reliability 
B)  raise reliability 
C)  neither raise nor lower reliability 
A)  lower reliability 
B)  raise reliability 
C)  neither raise nor lower reliability

Question 10

Four groups of sixth grade students took the same test in reading.The reliability coefficient will be highest for

Accepted Answer

A)  students with similar intelligence test scores and a similar background in reading. 
B)  students with similar intelligence test scores but varying in their background in reading. 
C)  students with varying intelligence test scores, all of whom have a similar background in reading. 
D)  students with varying intelligence test scores and a varying background in reading. 
A)  students with similar intelligence test scores and a similar background in reading. 
B)  students with similar intelligence test scores but varying in their background in reading. 
C)  students with varying intelligence test scores, all of whom have a similar background in reading. 
D)  students with varying intelligence test scores and a varying background in reading.

Question 11

Exhibit 9-7: The following results were obtained when two forms of a criterion-referenced test were administered to a sample of 50 students:
Form 1
Nonmaster Master
  
-Refer to Exhibit 9-7.Calculate the agreement coefficient for this test.

Accepted Answer

A)  .76 
B)  .78 
C)  .80 
D)  .86 
E)  .90 
A)  .76 
B)  .78 
C)  .80 
D)  .86 
E)  .90

Question 12

An investigator computed the split-half reliability coefficient of a test and found it to be .85.Later an equivalent form of the test was prepared and the reliability computed by administering the two forms to a group.One might expect that the reliability coefficient obtained by the latter procedure would be

Accepted Answer

A)  lower than .85. 
B)  higher than .85. 
C)  also .85. 
A)  lower than .85. 
B)  higher than .85. 
C)  also .85.

Question 13

Miss Smith compares the items on the Powers Chemistry Test to the content and objectives in her chemistry course.Miss Smith is most concerned with

Accepted Answer

A)  validity evidence based on relationship to other variables. 
B)  validity evidence based on content. 
C)  validity evidence based on internal structure. 
D)  stability reliability. 
E)  equivalent forms reliability. 
A)  validity evidence based on relationship to other variables. 
B)  validity evidence based on content. 
C)  validity evidence based on internal structure. 
D)  stability reliability. 
E)  equivalent forms reliability.

Question 14

One way to describe the score reliability of a criterion-referenced test is in terms of the consistency with which individuals

Accepted Answer

A)  obtain the same scores on a retest. 
B)  maintain their same relative position in the group on a retest. 
C)  obtain the same scores on the odd and even halves of the test. 
D)  achieve mastery on two different forms of the test. 
A)  obtain the same scores on a retest. 
B)  maintain their same relative position in the group on a retest. 
C)  obtain the same scores on the odd and even halves of the test. 
D)  achieve mastery on two different forms of the test.

Question 15

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher correlates students' scores on the test with the final semester grade received in the course.

Accepted Answer

A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance 
A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance

Question 16

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions.
-Refer to Exhibit 9-1.The test predicts performance in foreign language study.

Accepted Answer

A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables 
A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables

Question 17

A language aptitude test is administered to 50 students who are entering an honors French course.After one semester, their scores from the final examination in the French course are correlated with the scores from the language aptitude test.The resulting correlation coefficient would provide what kind of evidence of the test's score validity?

Accepted Answer

A)  Content 
B)  Test-retest 
C)  Concurrent 
D)  Criterion-related 
A)  Content 
B)  Test-retest 
C)  Concurrent 
D)  Criterion-related

Question 18

Low correlations with tests measuring different constructs provide ____ evidence for the score validity of an instrument.

Accepted Answer

A)  convergent 
B)  concurrent 
C)  discriminant 
D)  predictive 
A)  convergent 
B)  concurrent 
C)  discriminant 
D)  predictive

Question 19

Which of the following statements is true?

Accepted Answer

A)  Reliable scores are nearly always valid. 
B)  Reliability is concerned with what a test measures. 
C)  A reliable test measures well whatever it measures. 
D)  Reliability of a test is more difficult than validity to determine. 
A)  Reliable scores are nearly always valid. 
B)  Reliability is concerned with what a test measures. 
C)  A reliable test measures well whatever it measures. 
D)  Reliability of a test is more difficult than validity to determine.

Question 20

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher tries to determine if the numerical reasoning test is really measuring numerical reasoning skills rather than ability to read the test items.

Accepted Answer

A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance 
A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance

Which of the following would represent discriminant evidence for the score validity of a test of numerical aptitude?

The textbook defines test reliability as the ratio between the variance of the

Evidence based on test-criterion relationships may vary from time to time and place to place.Researchers attribute this lack of agreement in validity studies to the

A test has a reliability coefficient of .75.This coefficient indicates that

The Kuder-Richardson 21 formula for estimating the score reliability of a classroom achievement test has the disadvantage that

Exhibit 9-5: Choose the method of estimating score reliability that would be most useful for each of the types of tests listed below. -Refer to Exhibit 9-5.A classroom achievement test used for grading purposes

Exhibit 9-4: Following is a list of testing practices.Assuming other things are equal, indicate whether the practice would lower reliability, raise reliability, or neither. -Refer to Exhibit 9-4.Removing ambiguous items from the test

Four groups of sixth grade students took the same test in reading.The reliability coefficient will be highest for

Exhibit 9-7: The following results were obtained when two forms of a criterion-referenced test were administered to a sample of 50 students: Form 1 Nonmaster Master -Refer to Exhibit 9-7.Calculate the agreement coefficient for this test.

Miss Smith compares the items on the Powers Chemistry Test to the content and objectives in her chemistry course.Miss Smith is most concerned with

One way to describe the score reliability of a criterion-referenced test is in terms of the consistency with which individuals

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher correlates students' scores on the test with the final semester grade received in the course.

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test predicts performance in foreign language study.

Low correlations with tests measuring different constructs provide ____ evidence for the score validity of an instrument.

Which of the following statements is true?

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher tries to determine if the numerical reasoning test is really measuring numerical reasoning skills rather than ability to read the test items.

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

Exam 9: Validity and Reliability

Which of the following would represent discriminant evidence for the score validity of a test of numerical aptitude?

The textbook defines test reliability as the ratio between the variance of the

Evidence based on test-criterion relationships may vary from time to time and place to place.Researchers attribute this lack of agreement in validity studies to the

A test has a reliability coefficient of .75.This coefficient indicates that

The Kuder-Richardson 21 formula for estimating the score reliability of a classroom achievement test has the disadvantage that

Exhibit 9-5: Choose the method of estimating score reliability that would be most useful for each of the types of tests listed below. -Refer to Exhibit 9-5.A classroom achievement test used for grading purposes

Exhibit 9-4: Following is a list of testing practices.Assuming other things are equal, indicate whether the practice would lower reliability, raise reliability, or neither. -Refer to Exhibit 9-4.Removing ambiguous items from the test

Four groups of sixth grade students took the same test in reading.The reliability coefficient will be highest for

Exhibit 9-7: The following results were obtained when two forms of a criterion-referenced test were administered to a sample of 50 students: Form 1 Nonmaster Master -Refer to Exhibit 9-7.Calculate the agreement coefficient for this test.

Miss Smith compares the items on the Powers Chemistry Test to the content and objectives in her chemistry course.Miss Smith is most concerned with

One way to describe the score reliability of a criterion-referenced test is in terms of the consistency with which individuals

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher correlates students' scores on the test with the final semester grade received in the course.

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The test predicts performance in foreign language study.

Low correlations with tests measuring different constructs provide ____ evidence for the score validity of an instrument.

Which of the following statements is true?

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher tries to determine if the numerical reasoning test is really measuring numerical reasoning skills rather than ability to read the test items.

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters