Question 1

Assuming the "rubber yardstick" shrinks and expands at random, what can be said about the distribution of scores from the rubber yardstick?

Accepted Answer

A) It will have a mean of zero (0). 
B) It will be normal. 
C) It will have a standard error of zero (0). 
D) It will be skewed. 
A) It will have a mean of zero (0). 
B) It will be normal. 
C) It will have a standard error of zero (0). 
D) It will be skewed. B

Question 2

Tests will be most reliable if they are

Accepted Answer

A) multidimensional. 
B) unidimensional. 
C) brief. 
D) criterion-referenced. 
A) multidimensional. 
B) unidimensional. 
C) brief. 
D) criterion-referenced. B

Question 3

The basic theory of reliability was first worked out by

Accepted Answer

A) Karl Pearson. 
B) Charles Spearman. 
C) Julian Stanley. 
D) Lee Cronbach. 
A) Karl Pearson. 
B) Charles Spearman. 
C) Julian Stanley. 
D) Lee Cronbach. B

Question 4

Tests designed according to item response theory

Accepted Answer

A) are no longer considered useful. 
B) can only be used with non-objective material 
C) yield more reliable results with fewer items 
D) provide low-tech methods for field use. 
A) are no longer considered useful. 
B) can only be used with non-objective material 
C) yield more reliable results with fewer items 
D) provide low-tech methods for field use.

Question 5

What is Cronbach known for?

Accepted Answer

A) Developing measures to evaluate sources of error 
B) Creating the basics of multivariate analysis 
C) Developed the basics of contemporary measurement theory 
D) Distinguished between objective and subjective measures 
A) Developing measures to evaluate sources of error 
B) Creating the basics of multivariate analysis 
C) Developed the basics of contemporary measurement theory 
D) Distinguished between objective and subjective measures

Question 6

The Spearman Brown formula corrects for deflated reliability due to

Accepted Answer

A) half-length tests. 
B) small sample size. 
C) systematic error. 
D) poor test item construction. 
A) half-length tests. 
B) small sample size. 
C) systematic error. 
D) poor test item construction.

Question 7

Approximately what value must a reliability coefficient have for most purposes in basic research?

Accepted Answer

A) .90 
B) .50 
C) .70 
D) .30 
A) .90 
B) .50 
C) .70 
D) .30

Question 8

The work of Charles Spearman combined what two measurement concepts?

Accepted Answer

A) mean and variance 
B) sample statistics and population parameters 
C) sampling error and correlation 
D) reliability and validity 
A) mean and variance 
B) sample statistics and population parameters 
C) sampling error and correlation 
D) reliability and validity

Question 9

A reliability coefficient of .60 suggests that

Accepted Answer

A) 64% of the variance on the test is error. 
B) 40% of the variance on the test is error. 
C) 78% of the variance on the test is error. 
D) the test can be used for clinical purposes but not for research. 
A) 64% of the variance on the test is error. 
B) 40% of the variance on the test is error. 
C) 78% of the variance on the test is error. 
D) the test can be used for clinical purposes but not for research.

Question 10

The kappa statistic is used to

Accepted Answer

A) assess the level of agreement among several observers. 
B) estimate the correlation between a continuous variable and an artificially dichotomous variable. 
C) estimate the percentage of disagreement between observers. 
D) estimate the validity of behavioral observation. 
A) assess the level of agreement among several observers. 
B) estimate the correlation between a continuous variable and an artificially dichotomous variable. 
C) estimate the percentage of disagreement between observers. 
D) estimate the validity of behavioral observation.

Question 11

A split-half correlation, KR 20, and coefficient alpha are all used to evaluate

Accepted Answer

A) standard errors of measurement. 
B) internal consistency. 
C) variance. 
D) validity. 
A) standard errors of measurement. 
B) internal consistency. 
C) variance. 
D) validity.

Question 12

Carryover effects only affect reliability when changes over time are

Accepted Answer

A) large. 
B) systematic. 
C) random. 
D) due to practice effects. 
A) large. 
B) systematic. 
C) random. 
D) due to practice effects.

Question 13

As opposed to reliability based on the classical test theory, ____ focuses on the range of item difficulty that is useful in assessing an individual's ability.

Accepted Answer

A) domain sampling 
B) internal consistency 
C) coefficient alpha 
D) item response theory 
A) domain sampling 
B) internal consistency 
C) coefficient alpha 
D) item response theory

Question 14

Which of the following is used to estimate the number of items that should be added to a test to achieve a specified reliability?

Accepted Answer

A) KR 20 
B) coefficient alpha 
C) Spearman-Brown prophecy formula 
D) split-half technique 
A) KR 20 
B) coefficient alpha 
C) Spearman-Brown prophecy formula 
D) split-half technique

Question 15

Classical Test Theory assumes

Accepted Answer

A) the length of a test has no bearing on its reliability. 
B) measurement errors occur systematically. 
C) it is not possible to estimate true scores. 
D) the distribution of random errors is the same for every respondent. 
A) the length of a test has no bearing on its reliability. 
B) measurement errors occur systematically. 
C) it is not possible to estimate true scores. 
D) the distribution of random errors is the same for every respondent.

Question 16

Describe some of the advantages and disadvantages associated with behavioral observation techniques. Provide examples.

Accepted Answer

Behavioral observation techniques have s

Question 17

Reliability theory combines De Moivre's concept of sampling error with Pearson's concept of _____________ in the context of measurement.

Accepted Answer

A) coefficient alpha 
B) internal consistency 
C) product moment correlation 
D) domain sampling 
A) coefficient alpha 
B) internal consistency 
C) product moment correlation 
D) domain sampling

Question 18

According to classical test theory, errors of measurement are

Accepted Answer

A) always overestimates of true score. 
B) always underestimates of true score. 
C) random. 
D) constant. 
A) always overestimates of true score. 
B) always underestimates of true score. 
C) random. 
D) constant.

Question 19

The prophecy formula is used to

Accepted Answer

A) predict expected values. 
B) estimate how long a test must be to achieve a desired level of reliability. 
C) estimate how long a test must be to achieve a desired level of validity. 
D) calculate variability. 
A) predict expected values. 
B) estimate how long a test must be to achieve a desired level of reliability. 
C) estimate how long a test must be to achieve a desired level of validity. 
D) calculate variability.

Question 20

Theoretically, reliability is

Accepted Answer

A) the correlation of the observed test score with the true score. 
B) the square root of the ratio of true to the observed score. 
C) the ratio of true to the observed score squared. 
D) not possible to define. 
A) the correlation of the observed test score with the true score. 
B) the square root of the ratio of true to the observed score. 
C) the ratio of true to the observed score squared. 
D) not possible to define.

Exam 4: Reliability

Assuming the "rubber yardstick" shrinks and expands at random, what can be said about the distribution of scores from the rubber yardstick?

Tests will be most reliable if they are

The basic theory of reliability was first worked out by

Tests designed according to item response theory

What is Cronbach known for?

The Spearman Brown formula corrects for deflated reliability due to

Approximately what value must a reliability coefficient have for most purposes in basic research?

The work of Charles Spearman combined what two measurement concepts?

A reliability coefficient of .60 suggests that

The kappa statistic is used to

A split-half correlation, KR 20, and coefficient alpha are all used to evaluate

Carryover effects only affect reliability when changes over time are

As opposed to reliability based on the classical test theory, ____ focuses on the range of item difficulty that is useful in assessing an individual's ability.

Which of the following is used to estimate the number of items that should be added to a test to achieve a specified reliability?

Classical Test Theory assumes

Describe some of the advantages and disadvantages associated with behavioral observation techniques. Provide examples.

Reliability theory combines De Moivre's concept of sampling error with Pearson's concept of _____________ in the context of measurement.

According to classical test theory, errors of measurement are

The prophecy formula is used to

Theoretically, reliability is

Introduction

Norms and Basic Statistics for Testing

Correlation and Regression

Validity

Writing and Evaluating Test Items

Test Administration

Interviewing Techniques

Theories of Intelligence and the Binet Scales

The Wechsler Intelligence Scales: Wais-Iv, Wisc-Iv, and Wppsi-III

Testing in Education: Tests of Ability in Education and Special Education

Standardized Tests in Education, Civil Service, and the Military

Applications in Clinical and Counseling Settings

Projective Personality Tests

Computers and Basic Psychological Science in Testing

Testing in Counseling Psychology

Testing in Health Psychology and Health Care

Testing in Industrial and Business Settings

Test Bias

Testing and the Law

The Future of Psychological Testing

Filters