Question 1

List four factors that affect the score reliability of a measuring instrument.

Accepted Answer

The length of the instrument, the variable being measured, the technique used for estimating reliability, and the heterogeneity of the subjects on the variable being measured.

Question 2

A split-half reliability coefficient of .60 means

Accepted Answer

A)  60 percent of the students can be expected to vary from their true score. 
B)  on retesting, 60 percent of the students can be expected to vary about 68 percent from their true score. 
C)  the measurements are 60 percent reliable. 
D)  40 percent of the measurements are reliable. 
E)  none of these are true. 
A)  60 percent of the students can be expected to vary from their true score. 
B)  on retesting, 60 percent of the students can be expected to vary about 68 percent from their true score. 
C)  the measurements are 60 percent reliable. 
D)  40 percent of the measurements are reliable. 
E)  none of these are true. E

Question 3

Exhibit 9-2: An achievement test for advanced math was developed for high school students.In the process of preparing the test, a number of steps were carried out.Choose the option that most directly relates to each of the following steps.
-Refer to Exhibit 9-2.For 5,000 cases, scores on the test were correlated with grades in freshman college mathematics.This step is concerned with

Accepted Answer

A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes. 
A)  reliability. 
B)  validity evidence based on content. 
C)  validity evidence based on relationship to the other variables. 
D)  validity evidence based on response processes. C

Question 4

In gathering convergent evidence in a validity study, one determines the correlation between measures of the ____ construct obtained by ____ methods.

Accepted Answer

A)  same, same 
B)  same, different 
C)  different, same 
D)  different, different 
A)  same, same 
B)  same, different 
C)  different, same 
D)  different, different

Question 5

On a standardized mathematics test, the reliability coefficient is reported to be .76.From this information, one could best determine

Accepted Answer

A)  the extent to which the test scores are correlated to classroom achievement in mathematics. 
B)  the extent to which errors of measurement have influenced the test scores. 
C)  the extent to which the test is a representative sample of relevant concepts in math. 
D)  on the average, the number of points students' scores will change when given an equivalent test. 
A)  the extent to which the test scores are correlated to classroom achievement in mathematics. 
B)  the extent to which errors of measurement have influenced the test scores. 
C)  the extent to which the test is a representative sample of relevant concepts in math. 
D)  on the average, the number of points students' scores will change when given an equivalent test.

Question 6

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions.
-Refer to Exhibit 9-1.The scores on Test A correlate highly with subjects' performance on Test B.

Accepted Answer

A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables 
A)  evidence based on content 
B)  evidence based on internal structure 
C)  evidence based on relationship to other variables

Question 7

The correlation between two equivalent forms of an objective test administered in immediate succession enables one to determine the proportion of error variance due to

Accepted Answer

A)  item homogeneity. 
B)  temporal fluctuation. 
C)  item sampling. 
D)  scorer reliability. 
E)  a and b 
A)  item homogeneity. 
B)  temporal fluctuation. 
C)  item sampling. 
D)  scorer reliability. 
E)  a and b

Question 8

A teacher constructed a math test and found that it correlates highly with grades students are receiving in their math class.She also learns that students who scored high on the test also made the best grades in the following math course.These findings provide ____ evidence of the test's validity.

Accepted Answer

A)  predictive 
B)  concurrent 
C)  predictive and concurrent 
D)  divergent and concurrent 
A)  predictive 
B)  concurrent 
C)  predictive and concurrent 
D)  divergent and concurrent

Question 9

In validating an inventory measure of need to achieve, a researcher correlated the scores from the inventory with a projective technique known to measure need to achieve.This is an example of

Accepted Answer

A)  content evidence. 
B)  external evidence. 
C)  convergent evidence. 
D)  divergent evidence. 
A)  content evidence. 
B)  external evidence. 
C)  convergent evidence. 
D)  divergent evidence.

Question 10

If the reliability coefficient for a set of test scores is .90, we know that

Accepted Answer

A)  90 % of the variance is true variance; 10 % is unknown. 
B)  90 % of the variance is true variance; 10 % is error. 
C)  90 % of the variance is true variance; 10 % is reliable. 
D)  81 % of the variance is true variance; 19 % is error. 
E)  81 % of the variance is true variance; 19 % is unknown. 
A)  90 % of the variance is true variance; 10 % is unknown. 
B)  90 % of the variance is true variance; 10 % is error. 
C)  90 % of the variance is true variance; 10 % is reliable. 
D)  81 % of the variance is true variance; 19 % is error. 
E)  81 % of the variance is true variance; 19 % is unknown.

Question 11

One would not use the Kuder-Richardson 20 coefficient to estimate the score reliability of a comprehensive multiple choice final examination in a beginning psychology course because

Accepted Answer

A)  Kuder-Richardson 20 requires two forms of a test. 
B)  the items are not of equal difficulty. 
C)  the items cover various content areas and skills. 
D)  All of these are true. 
E)  b and c 
A)  Kuder-Richardson 20 requires two forms of a test. 
B)  the items are not of equal difficulty. 
C)  the items cover various content areas and skills. 
D)  All of these are true. 
E)  b and c

Question 12

To estimate changes in test reliability that would result from changing the length of a test, one would use the

Accepted Answer

A)  phi coefficient. 
B)  Kuder-Richardson 20. 
C)  Spearman-Brown. 
D)  coefficient alpha. 
A)  phi coefficient. 
B)  Kuder-Richardson 20. 
C)  Spearman-Brown. 
D)  coefficient alpha.

Question 13

The ability of a music aptitude test to differentiate among individuals who are known to differ in music ability provides evidence of the test's

Accepted Answer

A)  objectivity. 
B)  reliability. 
C)  validity. 
D)  consequential usefulness. 
A)  objectivity. 
B)  reliability. 
C)  validity. 
D)  consequential usefulness.

Question 14

Convergent evidence for the score validity of a reading achievement test would include the correlation between the reading test scores and

Accepted Answer

A)  grades in reading class. 
B)  grades in math class. 
C)  scores on a math achievement test. 
D)  scores on another reading test. 
E)  a and d 
A)  grades in reading class. 
B)  grades in math class. 
C)  scores on a math achievement test. 
D)  scores on another reading test. 
E)  a and d

Question 15

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions.
-Refer to Exhibit 9-6.A teacher examines an achievement test to see how well it covers the content and objectives covered in the course.

Accepted Answer

A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance 
A)  evidence based on content 
B)  evidence based on relationship to other variables 
C)  evidence based on construct-relevant variance

Question 16

Test validity is to ____ error as reliability is to ____ error.

Accepted Answer

A)  systematic, random 
B)  random, systematic 
A)  systematic, random 
B)  random, systematic

Question 17

A test has a reliability coefficient of .84.What percent of test variance is error?

Accepted Answer

A)  4 
B)  16 
C)  32 
D)  71 
E)  84 
A)  4 
B)  16 
C)  32 
D)  71 
E)  84

Question 18

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below.
-Refer to Exhibit 9-10.Scores on odd items correlated with scores on even items across test takers.

Accepted Answer

A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson 
A)  test-retest 
B)  alternate form 
C)  split-half 
D)  Kuder-Richardson

Question 19

Which of the following test characteristics would be most affected by using a short test rather than a longer one?

Accepted Answer

A)  Objectivity 
B)  Validity 
C)  Reliability 
D)  Standardization 
A)  Objectivity 
B)  Validity 
C)  Reliability 
D)  Standardization

Question 20

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples.
-Refer to Exhibit 9-13.The correlation between test scores and measures of another construct.

Accepted Answer

A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables 
A)  Content 
B)  Response processes 
C)  Internal structure 
D)  Relationship with other variables

List four factors that affect the score reliability of a measuring instrument.

A split-half reliability coefficient of .60 means

In gathering convergent evidence in a validity study, one determines the correlation between measures of the construct obtained by methods.

On a standardized mathematics test, the reliability coefficient is reported to be .76.From this information, one could best determine

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The scores on Test A correlate highly with subjects' performance on Test B.

The correlation between two equivalent forms of an objective test administered in immediate succession enables one to determine the proportion of error variance due to

A teacher constructed a math test and found that it correlates highly with grades students are receiving in their math class.She also learns that students who scored high on the test also made the best grades in the following math course.These findings provide ____ evidence of the test's validity.

In validating an inventory measure of need to achieve, a researcher correlated the scores from the inventory with a projective technique known to measure need to achieve.This is an example of

If the reliability coefficient for a set of test scores is .90, we know that

One would not use the Kuder-Richardson 20 coefficient to estimate the score reliability of a comprehensive multiple choice final examination in a beginning psychology course because

To estimate changes in test reliability that would result from changing the length of a test, one would use the

The ability of a music aptitude test to differentiate among individuals who are known to differ in music ability provides evidence of the test's

Convergent evidence for the score validity of a reading achievement test would include the correlation between the reading test scores and

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher examines an achievement test to see how well it covers the content and objectives covered in the course.

Test validity is to error as reliability is to error.

A test has a reliability coefficient of .84.What percent of test variance is error?

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Scores on odd items correlated with scores on even items across test takers.

Which of the following test characteristics would be most affected by using a short test rather than a longer one?

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The correlation between test scores and measures of another construct.

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

Exam 9: Validity and Reliability

List four factors that affect the score reliability of a measuring instrument.

A split-half reliability coefficient of .60 means

In gathering convergent evidence in a validity study, one determines the correlation between measures of the ____ construct obtained by ____ methods.

On a standardized mathematics test, the reliability coefficient is reported to be .76.From this information, one could best determine

Exhibit 9-1: Choose the type of evidence for validity that is referred to in the following questions. -Refer to Exhibit 9-1.The scores on Test A correlate highly with subjects' performance on Test B.

The correlation between two equivalent forms of an objective test administered in immediate succession enables one to determine the proportion of error variance due to

A teacher constructed a math test and found that it correlates highly with grades students are receiving in their math class.She also learns that students who scored high on the test also made the best grades in the following math course.These findings provide ____ evidence of the test's validity.

In validating an inventory measure of need to achieve, a researcher correlated the scores from the inventory with a projective technique known to measure need to achieve.This is an example of

If the reliability coefficient for a set of test scores is .90, we know that

One would not use the Kuder-Richardson 20 coefficient to estimate the score reliability of a comprehensive multiple choice final examination in a beginning psychology course because

To estimate changes in test reliability that would result from changing the length of a test, one would use the

The ability of a music aptitude test to differentiate among individuals who are known to differ in music ability provides evidence of the test's

Convergent evidence for the score validity of a reading achievement test would include the correlation between the reading test scores and

Exhibit 9-6: Indicate which type of evidence is being gathered in the following questions. -Refer to Exhibit 9-6.A teacher examines an achievement test to see how well it covers the content and objectives covered in the course.

Test validity is to ____ error as reliability is to ____ error.

A test has a reliability coefficient of .84.What percent of test variance is error?

Exhibit 9-10: Indicate the type of reliability that would result from the procedures described below. -Refer to Exhibit 9-10.Scores on odd items correlated with scores on even items across test takers.

Which of the following test characteristics would be most affected by using a short test rather than a longer one?

Exhibit 9-13: Various types of evidence may be gathered in the process of validating a test.Choose the type of evidence that is illustrated in the examples. -Refer to Exhibit 9-13.The correlation between test scores and measures of another construct.

The Nature of Scientific Inquiry

The Scientific Approach in Education

he Research Problem

Reviewing the Literature

The Hypothesis

Descriptive Statistics

Sampling and Inferential Statistics

Tools of Research

Experimental Research

Experimental Research Design

Ex Post Facto Research

Correlation Research

Survey Research

Defining and Designing Qualitative Research

Types of Qualitative Research

Analyzing and Reporting Qualitative Research

Action Research

Mixed Methods Research

Guidelines for Writing Research Proposals

Interpreting and Reporting Results of Quantitative Research

Filters

In gathering convergent evidence in a validity study, one determines the correlation between measures of the construct obtained by methods.

Test validity is to error as reliability is to error.