Question 1

The reliability of composite scores is generally ________ the reliability of the individual scores that contributed to the composite.

Accepted Answer

A) equal to 
B) higher than 
C) lower than 
A) equal to 
B) higher than 
C) lower than B

Question 2

There is (a)_______ relationship between an individual's level on a construct and the amount of measurement error impacting their observed score.

Accepted Answer

A) no 
B) weak 
C) moderate 
D) strong 
A) no 
B) weak 
C) moderate 
D) strong A

Question 3

The mean of error scores in a population is equal to ________.

Accepted Answer

A) 0.1 
B) 0 
C) 1 
D) 10 
A) 0.1 
B) 0 
C) 1 
D) 10 B

Question 4

As reliability increases,confidence intervals:

Accepted Answer

A) decrease. 
B) do not change. 
C) increase. 
A) decrease. 
B) do not change. 
C) increase.

Question 5

_________ refers to the consistency or stability of test scores.

Accepted Answer

A) Measurement error 
B) Reliability 
C) Variance 
D) Validity 
A) Measurement error 
B) Reliability 
C) Variance 
D) Validity

Question 6

_________ is applicable when test items are scored dichotomously while _________ can be used when test items produce multiple values.

Accepted Answer

A) Coefficient Alpha; KR 20 
B) KR 20; Coefficient Alpha 
C) Split-half reliability; test-retest reliability 
D) Test-retest reliability; split-half reliability 
A) Coefficient Alpha; KR 20 
B) KR 20; Coefficient Alpha 
C) Split-half reliability; test-retest reliability 
D) Test-retest reliability; split-half reliability

Question 7

__________ is sensitive to the heterogeneity of the test content.

Accepted Answer

A) Alternate-from reliability with delayed administration 
B) Coefficient Alpha 
C) Split-half reliability 
D) Test-retest reliability 
A) Alternate-from reliability with delayed administration 
B) Coefficient Alpha 
C) Split-half reliability 
D) Test-retest reliability

Question 8

________ is/are usually considered the largest source of error in test scores.

Accepted Answer

A) Administrative errors 
B) Clerical errors 
C) Content sampling 
D) Time sampling 
A) Administrative errors 
B) Clerical errors 
C) Content sampling 
D) Time sampling

Question 9

Split-half reliability is primarily sensitive to measurement error due to:

Accepted Answer

A) content sampling. 
B) content sampling and temporal instability. 
C) practice effects. 
D) temporal instability. 
A) content sampling. 
B) content sampling and temporal instability. 
C) practice effects. 
D) temporal instability.

Question 10

What happens to the size of confidence intervals as reliability coefficients increase?

Accepted Answer

A) They decrease. 
B) They increase. 
C) They remain the same. 
D) It is indeterminate - it depends on the construct being measured. 
A) They decrease. 
B) They increase. 
C) They remain the same. 
D) It is indeterminate - it depends on the construct being measured.

Question 11

As a general rule,_________ tests produce more reliable scores than ______ tests.

Accepted Answer

A) brief; lengthy 
B) intensive; extensive 
C) longer; shorter 
D) shorter; longer 
A) brief; lengthy 
B) intensive; extensive 
C) longer; shorter 
D) shorter; longer

Question 12

Generalizability Theory typically uses which statistical procedure to estimate reliability?

Accepted Answer

A) Analysis of Variance (ANOV
A)  
B) Correlation Coefficient 
C) Linear Regression 
D) Multivariate Analysis of Vvariance (MANOV
A)  
A) Analysis of Variance (ANOV
A)  
B) Correlation Coefficient 
C) Linear Regression 
D) Multivariate Analysis of Vvariance (MANOV
A)

Question 13

Which method of rating reliability would be appropriate for scores from a speed test?

Accepted Answer

A) Coefficient Alpha 
B) Kuder Richardson 20 
C) Test-retest reliability 
D) Split-half reliability 
A) Coefficient Alpha 
B) Kuder Richardson 20 
C) Test-retest reliability 
D) Split-half reliability

Question 14

The ____________ is an index of the amount of measurement error in test scores and is used in calculating confidence intervals.

Accepted Answer

A) Standard Error of Estimate 
B) Standard Error of Measurement 
C) Spearman-Brown Coefficient 
D) Skew Coefficient 
A) Standard Error of Estimate 
B) Standard Error of Measurement 
C) Spearman-Brown Coefficient 
D) Skew Coefficient

Question 15

If the reliability coefficient equals .81,the reliability index equals:

Accepted Answer

A) .19. 
B) .81. 
C) .90. 
D) 1.0. 
A) .19. 
B) .81. 
C) .90. 
D) 1.0.

Question 16

On a test comprised of constructed response items,it is important to consider:

Accepted Answer

A) administrative errors. 
B) clerical errors. 
C) inter-rater differences. 
D) time sampling. 
A) administrative errors. 
B) clerical errors. 
C) inter-rater differences. 
D) time sampling.

Question 17

The uncorrected split-half reliability coefficient __________ the reliability of the full test score.

Accepted Answer

A) accurately reflects 
B) overestimates 
C) underestimates 
D) provides an indeterminate reflection of 
A) accurately reflects 
B) overestimates 
C) underestimates 
D) provides an indeterminate reflection of

Question 18

The Spearman-Brown formula is used to:

Accepted Answer

A) correct a split-half reliability coefficient. 
B) estimate construct reliability. 
C) perform a curvilinear transformation of the scores. 
D) perform a linear transformation of the scores. 
A) correct a split-half reliability coefficient. 
B) estimate construct reliability. 
C) perform a curvilinear transformation of the scores. 
D) perform a linear transformation of the scores.

Question 19

The reliability index reflects the correlation between:

Accepted Answer

A) true scores and observed scores. 
B) true scores and measurement error. 
C) observed scores and measurement error. 
D) true scores and true scores. 
A) true scores and observed scores. 
B) true scores and measurement error. 
C) observed scores and measurement error. 
D) true scores and true scores.

Question 20

Which of the following methods is necessary when estimating the reliability of a test score intended to predict performance at a future time?

Accepted Answer

A) Alternate form reliability with simultaneous administration 
B) Coefficient alpha 
C) KR 20 
D) Test-rest reliability 
A) Alternate form reliability with simultaneous administration 
B) Coefficient alpha 
C) KR 20 
D) Test-rest reliability

The reliability of composite scores is generally ________ the reliability of the individual scores that contributed to the composite.

There is (a)_______ relationship between an individual's level on a construct and the amount of measurement error impacting their observed score.

The mean of error scores in a population is equal to ________.

As reliability increases,confidence intervals:

_________ refers to the consistency or stability of test scores.

_ is applicable when test items are scored dichotomously while _ can be used when test items produce multiple values.

__________ is sensitive to the heterogeneity of the test content.

________ is/are usually considered the largest source of error in test scores.

Split-half reliability is primarily sensitive to measurement error due to:

What happens to the size of confidence intervals as reliability coefficients increase?

As a general rule,___ tests produce more reliable scores than tests.

Generalizability Theory typically uses which statistical procedure to estimate reliability?

Which method of rating reliability would be appropriate for scores from a speed test?

The ____________ is an index of the amount of measurement error in test scores and is used in calculating confidence intervals.

If the reliability coefficient equals .81,the reliability index equals:

On a test comprised of constructed response items,it is important to consider:

The uncorrected split-half reliability coefficient __________ the reliability of the full test score.

The Spearman-Brown formula is used to:

The reliability index reflects the correlation between:

Which of the following methods is necessary when estimating the reliability of a test score intended to predict performance at a future time?

Introduction to Psychological Testing: Why We Do It and What It Is

The Basics Statistics of Measurement

The Meaning of Test Scores

Validity

Item Development

Item Analysis: Methods for Fitting the Right Items to the Right Test

Achievement Tests in the Era of High-Stakes Assessment

Assessment of Intelligence

Assessment of Personality

Behavioral Assessment

Employment and Vocational Testing

Neuropsychological Testing

Forensic Applications of Psychological Assessment

The Problem of Bias in Psychological Assessment

Assessment Accommodations

Best Practices: Legal and Ethical Issues

How to Develop a Psychological Test: a Practical Approach

Filters

Exam 4: Reliability

The reliability of composite scores is generally ________ the reliability of the individual scores that contributed to the composite.

There is (a)_______ relationship between an individual's level on a construct and the amount of measurement error impacting their observed score.

The mean of error scores in a population is equal to ________.

As reliability increases,confidence intervals:

_________ refers to the consistency or stability of test scores.

_________ is applicable when test items are scored dichotomously while _________ can be used when test items produce multiple values.

__________ is sensitive to the heterogeneity of the test content.

________ is/are usually considered the largest source of error in test scores.

Split-half reliability is primarily sensitive to measurement error due to:

What happens to the size of confidence intervals as reliability coefficients increase?

As a general rule,_________ tests produce more reliable scores than ______ tests.

Generalizability Theory typically uses which statistical procedure to estimate reliability?

Which method of rating reliability would be appropriate for scores from a speed test?

The ____________ is an index of the amount of measurement error in test scores and is used in calculating confidence intervals.

If the reliability coefficient equals .81,the reliability index equals:

On a test comprised of constructed response items,it is important to consider:

The uncorrected split-half reliability coefficient __________ the reliability of the full test score.

The Spearman-Brown formula is used to:

The reliability index reflects the correlation between:

Which of the following methods is necessary when estimating the reliability of a test score intended to predict performance at a future time?

Introduction to Psychological Testing: Why We Do It and What It Is

The Basics Statistics of Measurement

The Meaning of Test Scores

Validity

Item Development

Item Analysis: Methods for Fitting the Right Items to the Right Test

Achievement Tests in the Era of High-Stakes Assessment

Assessment of Intelligence

Assessment of Personality

Behavioral Assessment

Employment and Vocational Testing

Neuropsychological Testing

Forensic Applications of Psychological Assessment

The Problem of Bias in Psychological Assessment

Assessment Accommodations

Best Practices: Legal and Ethical Issues

How to Develop a Psychological Test: a Practical Approach

Filters

_ is applicable when test items are scored dichotomously while _ can be used when test items produce multiple values.

As a general rule,___ tests produce more reliable scores than tests.