Question 1

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained at a later time is known as:

Accepted Answer

A)  Norm-Related Evidence 
B)  Concurrent Evidence 
C)  Predictive Evidence 
D)  Discriminant Evidence 
A)  Norm-Related Evidence 
B)  Concurrent Evidence 
C)  Predictive Evidence 
D)  Discriminant Evidence

Question 2

Criterion-related validity evidence refers to whether a test:

Accepted Answer

A)  Adequately samples the content it purports to measure 
B)  Is predictive of a future or concurrent behavior 
C)  Is internally consistent 
D)  Meets the criterion for reliability 
A)  Adequately samples the content it purports to measure 
B)  Is predictive of a future or concurrent behavior 
C)  Is internally consistent 
D)  Meets the criterion for reliability

Question 3

Evidence based on content is often used in the process of validation.

Accepted Answer

A) True 
 B)False

Question 4

Intelligence tests typically measure:

Accepted Answer

A)  The ability to think abstractly and learn from experience 
B)  State variables 
C)  Learning styles 
D)  School achievement ability 
A)  The ability to think abstractly and learn from experience 
B)  State variables 
C)  Learning styles 
D)  School achievement ability

Question 5

A research team is developing a test of school readiness. They believe that there are four dimensions of school readiness. They completed a factor analysis on their data. If the test was developed well, how many factors should have been evident in the factor analysis?

Accepted Answer

A)  One 
B)  Three 
C)  Four 
D)  There is not enough information to tell. 
A)  One 
B)  Three 
C)  Four 
D)  There is not enough information to tell.

Question 6

All valid tests are reliable.

Accepted Answer

A) True 
 B)False

Question 7

Jane needs to calculate interscorer reliability for her study. She will do this by:

Accepted Answer

A)  Correlating the judgments of two raters 
B)  Calculating coefficient alpha 
C)  Calculating a test-retest correlation 
D)  Calculating KR-20 
A)  Correlating the judgments of two raters 
B)  Calculating coefficient alpha 
C)  Calculating a test-retest correlation 
D)  Calculating KR-20

Question 8

All reliable tests are valid.

Accepted Answer

A) True 
 B)False

Question 9

The reliability of a test refers to:

Accepted Answer

A)  The consistency or stability of the test scores. 
B)  Whether a test measures what it is supposed to measure. 
C)  Whether a test is valid. 
D)  Its content sampling. 
A)  The consistency or stability of the test scores. 
B)  Whether a test measures what it is supposed to measure. 
C)  Whether a test is valid. 
D)  Its content sampling.

Question 10

Consistency of scores on a test over time is known as:

Accepted Answer

A)  Reliability Coefficient 
B)  Test-Retest Reliability 
C)  Equivalent Forms Reliability 
D)  Internal Consistency 
A)  Reliability Coefficient 
B)  Test-Retest Reliability 
C)  Equivalent Forms Reliability 
D)  Internal Consistency

Question 11

A researcher wishing to determine the consistency of scores on a test decided to use split-half reliability. To do so the researcher put items 1-50 in one group and items 51-100 in the second group. This is the recommended way to divide the items for this type of reliability measure.

Accepted Answer

A) True 
 B)False

Question 12

The Spearman-Brown formula is used to:

Accepted Answer

A)  Correct validity coefficients 
B)  Correct test-retest reliability coefficients 
C)  Correct equivalent forms reliability coefficients 
D)  Correct the split-half reliability coefficient 
A)  Correct validity coefficients 
B)  Correct test-retest reliability coefficients 
C)  Correct equivalent forms reliability coefficients 
D)  Correct the split-half reliability coefficient

Question 13

The predictive ability of preschool tests is as good as tests used for adults.

Accepted Answer

A) True 
 B)False

Question 14

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance is which of the following?

Accepted Answer

A)  Test-retest evidence. 
B)  Concurrent evidence 
C)  Criterion-related evidence 
D)  Alternative forms evidence 
A)  Test-retest evidence. 
B)  Concurrent evidence 
C)  Criterion-related evidence 
D)  Alternative forms evidence

Question 15

Concurrent validity evidence refers to:

Accepted Answer

A)  The relationship between test scores and criterion scores obtained at the same time 
B)  Whether scores on a test correlated with scores on the same test given a week later 
C)  Whether a test predicts scores on some criterion measure (e.g., success in training) 
D)  Whether a test has an adequate coefficient alpha 
A)  The relationship between test scores and criterion scores obtained at the same time 
B)  Whether scores on a test correlated with scores on the same test given a week later 
C)  Whether a test predicts scores on some criterion measure (e.g., success in training) 
D)  Whether a test has an adequate coefficient alpha

Question 16

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs is known as:

Accepted Answer

A)  Criterion-Related Evidence 
B)  Concurrent Evidence 
C)  Convergent Evidence 
D)  Discriminant Evidence 
A)  Criterion-Related Evidence 
B)  Concurrent Evidence 
C)  Convergent Evidence 
D)  Discriminant Evidence

Question 17

Equivalent-forms reliability refers to:

Accepted Answer

A)  The consistency of a group of individuals' scores on two different forms of a test measuring the same thing 
B)  Whether scores on the first half of a test correlate with scores on the second half 
C)  Whether experts agree that a test measures what it is supposed to measure 
D)  Whether a test is predictive of behavior 
A)  The consistency of a group of individuals' scores on two different forms of a test measuring the same thing 
B)  Whether scores on the first half of a test correlate with scores on the second half 
C)  Whether experts agree that a test measures what it is supposed to measure 
D)  Whether a test is predictive of behavior

Question 18

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct is known as:

Accepted Answer

A)  Criterion-Related Evidence 
B)  Predictive Evidence 
C)  Convergent Evidence 
D)  Discriminant Evidence 
A)  Criterion-Related Evidence 
B)  Predictive Evidence 
C)  Convergent Evidence 
D)  Discriminant Evidence

Question 19

Explain the meaning of reliability.

Accepted Answer

Reliability refers to the consistency, d

Question 20

The consistency with which the items on a test measure a single construct is called:

Accepted Answer

A)  Reliability Coefficient 
B)  Test-Retest Reliability 
C)  Equivalent Forms Reliability 
D)  Internal Consistency 
A)  Reliability Coefficient 
B)  Test-Retest Reliability 
C)  Equivalent Forms Reliability 
D)  Internal Consistency

Exam 7: Standardized Measurement and Assessment

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained at a later time is known as:

Criterion-related validity evidence refers to whether a test:

Evidence based on content is often used in the process of validation.

Intelligence tests typically measure:

A research team is developing a test of school readiness. They believe that there are four dimensions of school readiness. They completed a factor analysis on their data. If the test was developed well, how many factors should have been evident in the factor analysis?

All valid tests are reliable.

Jane needs to calculate interscorer reliability for her study. She will do this by:

All reliable tests are valid.

The reliability of a test refers to:

Consistency of scores on a test over time is known as:

A researcher wishing to determine the consistency of scores on a test decided to use split-half reliability. To do so the researcher put items 1-50 in one group and items 51-100 in the second group. This is the recommended way to divide the items for this type of reliability measure.

The Spearman-Brown formula is used to:

The predictive ability of preschool tests is as good as tests used for adults.

Validity evidence based on the extent to which scores from a test can be used to predict or infer performance on some criterion such as a test or future performance is which of the following?

Concurrent validity evidence refers to:

Evidence that the scores on your focal test are not highly related to the scores from other tests that are designed to measure theoretically different constructs is known as:

Equivalent-forms reliability refers to:

Validity evidence based on the relationship between the focal test scores and independent measures of the same construct is known as:

Explain the meaning of reliability.

The consistency with which the items on a test measure a single construct is called:

Introduction to Educational Research

Quantitative, Qualitative, and Mixed Research

Action Research for Lifelong Learning

How to Review the Literature and Develop Research Questions

How to Write a Research Proposal

Research Ethics

How to Construct a Questionnaire

Methods of Data Collection

Sampling in Quantitative, Qualitative, and Mixed Research

Validity of Research Results in Quantitative, Qualitative, and Mixed Research

Experimental Research: Weak and Strong Designs

Experimental Research: Quasi and Single-Case Designs

Nonexperimental Quantitative Research

Narrative Inquiry and Case Study Research

Phenomenology, Ethnography, and Grounded Theory

Mixed Research

Descriptive Statistics

Inferential Statistics

Data Analysis in Qualitative and Mixed Research

How to Prepare a Research Report and Use Apa Style Guidelines

Filters

Validity evidence based on the relationship between test scores collected at one point in time and criterion scores obtained ata later time is known as: