Question 1

The principal purpose of generalizability theory is to investigate ___.

Accepted Answer

A)  several examinees at once 
B)  several different tests at once 
C)  several sources of unreliability at once 
D)  several types of validity at once 
A)  several examinees at once 
B)  several different tests at once 
C)  several sources of unreliability at once 
D)  several types of validity at once C

Question 2

What correction is applied after determining the correlation between two halves of a test in order to express the reliability of a full-length test?

Accepted Answer

A)  Alternate form 
B)  Cronbach's 
C)  Spearman-Brown 
D)  Pearson's 
A)  Alternate form 
B)  Cronbach's 
C)  Spearman-Brown 
D)  Pearson's C

Question 3

If true variance equals observed variance, then reliability (r) will be ___.

Accepted Answer

A)  +1.00 
B)  .00 
C)  +.50 
D)  -.50 
A)  +1.00 
B)  .00 
C)  +.50 
D)  -.50 A

Question 4

The summation of all unsystematic influences on a person's test score is called the _______ score.

Accepted Answer

A)  observed 
B)  true 
C)  error 
D)  actual 
A)  observed 
B)  true 
C)  error 
D)  actual

Question 5

The precision of measurement index obtained in item response theory is a type of _________ reliability.

Accepted Answer

A)  test-retest 
B)  inter-scorer 
C)  internal consistency 
D)  alternate form 
A)  test-retest 
B)  inter-scorer 
C)  internal consistency 
D)  alternate form

Question 6

The mean and SD for a test are 80 and 10, respectively. The test-retest reliability is .84. The standard error of measurement (SEM) is ___.

Accepted Answer

A)  1 
B)  4 
C)  8 
D)  8.4 
A)  1 
B)  4 
C)  8 
D)  8.4

Question 7

Variations in health and mood relate primarily to what source of unreliability?

Accepted Answer

A)  content 
B)  scoring 
C)  administrative conditions 
D)  personal conditions 
A)  content 
B)  scoring 
C)  administrative conditions 
D)  personal conditions

Question 8

When we are estimating a Y score (i.e., Y') based on knowledge of the relationship between X and Y, the basic definition of the prediction equation is ___.

Accepted Answer

A)  Y' = a + bX 
B)  Y' = (b)(X)(a) 
C)  Y' = a + X + b 
D)  Y' = (X/b) + a 
A)  Y' = a + bX 
B)  Y' = (b)(X)(a) 
C)  Y' = a + X + b 
D)  Y' = (X/b) + a

Question 9

In psychological testing, which is the best synonym for reliability?

Accepted Answer

A)  consistency 
B)  validity 
C)  continuity 
D)  difficulty 
A)  consistency 
B)  validity 
C)  continuity 
D)  difficulty

Question 10

Which of the following is the least frequently used method of expressing test reliability?

Accepted Answer

A)  internal consistency reliability 
B)  test-retest reliability 
C)  inter-scorer reliability 
D)  alternate form reliability 
A)  internal consistency reliability 
B)  test-retest reliability 
C)  inter-scorer reliability 
D)  alternate form reliability

Question 11

In general, internal consistency reliability is maximized when the average item difficulty is -

Accepted Answer

A)  .10 
B)  .50 
C)  .75 
D)  .95 
A)  .10 
B)  .50 
C)  .75 
D)  .95

Question 12

The standard error of measurement is a type of ___.

Accepted Answer

A)  correlation coefficient 
B)  mean (average) 
C)  standard deviation 
D)  significance test 
A)  correlation coefficient 
B)  mean (average) 
C)  standard deviation 
D)  significance test

Question 13

We know the reliability of a 90-item test. We wish to estimate the reliability of the test if we use only 30 items from it. What formula will help make this estimation?

Accepted Answer

A)  McGowan's 
B)  Cronbach's 
C)  Spearman-Brown 
D)  Pearson's 
A)  McGowan's 
B)  Cronbach's 
C)  Spearman-Brown 
D)  Pearson's

Question 14

Which statistical method provides the framework for describing generalizability theory?

Accepted Answer

A)  factor analysis 
B)  analysis of variance 
C)  multiple correlation 
D)  descriptive statistics 
A)  factor analysis 
B)  analysis of variance 
C)  multiple correlation 
D)  descriptive statistics

Question 15

We observe that a correlation coefficient was determined on a group much more homogeneous than the group in which we are interested. To estimate the correlation in the group in which we are interested, we would apply the formula for _______.

Accepted Answer

A)  Correction for range restriction 
B)  Correction for unreliability 
C)  Correction for continuity 
D)  Correction for small size 
A)  Correction for range restriction 
B)  Correction for unreliability 
C)  Correction for continuity 
D)  Correction for small size

Question 16

What generalization does the text make about the reliability of subscores within total scores? Subscore reliability is almost always ___ the reliability of the total score.

Accepted Answer

A)  less than 
B)  greater than 
C)  the same as 
A)  less than 
B)  greater than 
C)  the same as

Question 17

A test must be _____ in order to be _____.

Accepted Answer

A)  short…reliable 
B)  machine-scored…reliable 
C)  published…useful 
D)  reliable…valid 
A)  short…reliable 
B)  machine-scored…reliable 
C)  published…useful 
D)  reliable…valid

Question 18

What generalization does the text make about the reliability of profiles? Profile reliability ___.?

Accepted Answer

A)  is less than the reliabilities of the individual tests in the profile 
B)  is greater than the reliabilities of the individual tests in the profile 
C)  is the same as the reliabilities of the individual tests in the profile 
A)  is less than the reliabilities of the individual tests in the profile 
B)  is greater than the reliabilities of the individual tests in the profile 
C)  is the same as the reliabilities of the individual tests in the profile

Question 19

You compare a student's scores on reading and math tests. So, what you are really interpreting is a difference. What would you expect the reliability of the difference to be in comparison to the reliabilities of the reading and math tests? Reliability of the difference is likely ___

Accepted Answer

A)  The average of the reliabilities of the two original tests 
B)  Noticeably less than reliabilities of the two original tests 
C)  Noticeably more than reliabilities of the two original tests 
D)  Somewhat higher than the reliabilities of the two original tests 
A)  The average of the reliabilities of the two original tests 
B)  Noticeably less than reliabilities of the two original tests 
C)  Noticeably more than reliabilities of the two original tests 
D)  Somewhat higher than the reliabilities of the two original tests

Question 20

The standard error of estimate for a predicted Y value will be zero, that is, there will be no error in prediction, when ___.

Accepted Answer

A)  r is + or - 1.00 
B)  r is .00 
C)  r is .50 
D)  SDy is 1.00 
A)  r is + or - 1.00 
B)  r is .00 
C)  r is .50 
D)  SDy is 1.00

The principal purpose of generalizability theory is to investigate ___.

What correction is applied after determining the correlation between two halves of a test in order to express the reliability of a full-length test?

If true variance equals observed variance, then reliability (r) will be ___.

The summation of all unsystematic influences on a person's test score is called the _______ score.

The precision of measurement index obtained in item response theory is a type of _________ reliability.

The mean and SD for a test are 80 and 10, respectively. The test-retest reliability is .84. The standard error of measurement (SEM) is ___.

Variations in health and mood relate primarily to what source of unreliability?

When we are estimating a Y score (i.e., Y') based on knowledge of the relationship between X and Y, the basic definition of the prediction equation is ___.

In psychological testing, which is the best synonym for reliability?

Which of the following is the least frequently used method of expressing test reliability?

In general, internal consistency reliability is maximized when the average item difficulty is -

The standard error of measurement is a type of ___.

We know the reliability of a 90-item test. We wish to estimate the reliability of the test if we use only 30 items from it. What formula will help make this estimation?

Which statistical method provides the framework for describing generalizability theory?

We observe that a correlation coefficient was determined on a group much more homogeneous than the group in which we are interested. To estimate the correlation in the group in which we are interested, we would apply the formula for _______.

What generalization does the text make about the reliability of subscores within total scores? Subscore reliability is almost always ___ the reliability of the total score.

A test must be _ in order to be _.

What generalization does the text make about the reliability of profiles? Profile reliability ___.?

You compare a student's scores on reading and math tests. So, what you are really interpreting is a difference. What would you expect the reliability of the difference to be in comparison to the reliabilities of the reading and math tests? Reliability of the difference is likely ___

The standard error of estimate for a predicted Y value will be zero, that is, there will be no error in prediction, when ___.

The World of Testing

Sources of Information About Tests

Test Norms

Validity

Test Development and Item Analysis

Fairness and Bias

Cognitive Abilities: Individual Tests

Cognitive Ability: Group Tests

Neuropsychological Assessment

Achievement Tests

Objective Personality Tests

Clinical Instruments and Methods

Projective Techniques

Interests and Attitudes

Ethical and Legal Issues

Filters

Exam 4: Reliability

The principal purpose of generalizability theory is to investigate ___.

What correction is applied after determining the correlation between two halves of a test in order to express the reliability of a full-length test?

If true variance equals observed variance, then reliability (r) will be ___.

The summation of all unsystematic influences on a person's test score is called the _______ score.

The precision of measurement index obtained in item response theory is a type of _________ reliability.

The mean and SD for a test are 80 and 10, respectively. The test-retest reliability is .84. The standard error of measurement (SEM) is ___.

Variations in health and mood relate primarily to what source of unreliability?

When we are estimating a Y score (i.e., Y') based on knowledge of the relationship between X and Y, the basic definition of the prediction equation is ___.

In psychological testing, which is the best synonym for reliability?

Which of the following is the least frequently used method of expressing test reliability?

In general, internal consistency reliability is maximized when the average item difficulty is -

The standard error of measurement is a type of ___.

We know the reliability of a 90-item test. We wish to estimate the reliability of the test if we use only 30 items from it. What formula will help make this estimation?

Which statistical method provides the framework for describing generalizability theory?

We observe that a correlation coefficient was determined on a group much more homogeneous than the group in which we are interested. To estimate the correlation in the group in which we are interested, we would apply the formula for _______.

What generalization does the text make about the reliability of subscores within total scores? Subscore reliability is almost always ___ the reliability of the total score.

A test must be _____ in order to be _____.

What generalization does the text make about the reliability of profiles? Profile reliability ___.?

You compare a student's scores on reading and math tests. So, what you are really interpreting is a difference. What would you expect the reliability of the difference to be in comparison to the reliabilities of the reading and math tests? Reliability of the difference is likely ___

The standard error of estimate for a predicted Y value will be zero, that is, there will be no error in prediction, when ___.

The World of Testing

Sources of Information About Tests

Test Norms

Validity

Test Development and Item Analysis

Fairness and Bias

Cognitive Abilities: Individual Tests

Cognitive Ability: Group Tests

Neuropsychological Assessment

Achievement Tests

Objective Personality Tests

Clinical Instruments and Methods

Projective Techniques

Interests and Attitudes

Ethical and Legal Issues

Filters

A test must be _ in order to be _.