Question 1

A nonparametric index for scorer agreement when the scores are nominal or ordinal is provided by ______.

Accepted Answer

A)  coefficient alpha 
B)  KR-20 
C)  Cohen's kappa 
D)  Spearman Brown 
A)  coefficient alpha 
B)  KR-20 
C)  Cohen's kappa 
D)  Spearman Brown C

Question 2

As the reliability/precision of a test decreases, which one of the following items increases?

Accepted Answer

A)  standard deviation 
B)  standard error of measurement 
C)  internal consistency 
D)  difficulty 
A)  standard deviation 
B)  standard error of measurement 
C)  internal consistency 
D)  difficulty B

Question 3

According to classical test theory, what would the reliability coefficient be when the variance of observed scores is equal to the variance of true scores?

Accepted Answer

A)  0 
B)  0.5 
C)  0.75 
D)  1.0 
A)  0 
B)  0.5 
C)  0.75 
D)  1.0 D

Question 4

What is the formula that Cronbach proposed for calculating internal consistency for questions that have more than two possible responses called?

Accepted Answer

A)  coefficient alpha 
B)  KR-20 
C)  product moment correlation 
D)  Spearman Brown 
A)  coefficient alpha 
B)  KR-20 
C)  product moment correlation 
D)  Spearman Brown

Question 5

Which one of the following is required to yield an accurate estimate of reliability/precision using the split halves method?

Accepted Answer

A)  the two halves must be equivalent in length and content 
B)  the scores on each half must be equivalent 
C)  the first half must contain more questions than the second half 
D)  the estimate must be calculated using the coefficient alpha 
A)  the two halves must be equivalent in length and content 
B)  the scores on each half must be equivalent 
C)  the first half must contain more questions than the second half 
D)  the estimate must be calculated using the coefficient alpha

Question 6

If a meteorologist uses a thermometer that always reads 1 degree higher than the actual temperature, then the error that results is ______. If a meteorologist is nearsighted and he reads the thermometer with a different amount and direction of inaccuracy each time, the error that results will be ______.

Accepted Answer

A)  reliable; unreliable 
B)  unreliable; reliable 
C)  random; systematic 
D)  systematic; random 
A)  reliable; unreliable 
B)  unreliable; reliable 
C)  random; systematic 
D)  systematic; random

Question 7

What is the unexplained difference between the true score (T) and the obtained score (X) called?

Accepted Answer

A)  systematic error 
B)  random error 
C)  internal consistency 
D)  coefficient alpha 
A)  systematic error 
B)  random error 
C)  internal consistency 
D)  coefficient alpha

Question 8

What do we call changes in test scores resulting from the sequence in which the tests were taken?

Accepted Answer

A)  practice effects 
B)  order effects 
C)  fatigue effects 
D)  alternate effects 
A)  practice effects 
B)  order effects 
C)  fatigue effects 
D)  alternate effects

Question 9

Rita scored 96 on an employment test, and Naomi scored 98 on the same test. Naomi believes that she has the highest score, but Rita disagrees. Which of the following would be most helpful in determining whether Naomi's score is statistically higher than Rita's score?

Accepted Answer

A)  the standard deviation and mean of the test scores 
B)  the standard error of measurement of the test scores 
C)  the reliability coefficient of the test scores 
D)  the coefficient of determination of the test scores 
A)  the standard deviation and mean of the test scores 
B)  the standard error of measurement of the test scores 
C)  the reliability coefficient of the test scores 
D)  the coefficient of determination of the test scores

Question 10

Which one of the following pairs of math questions would be most likely to produce an internally consistent result?

Accepted Answer

A)  8 − 10 = ? and 500 + 224 = ? 
B)  22 × 48 = ? and 48 + 22 =? 
C)  (−8) − (+10) = ? and 8 × 10 = ? 
D)  8 × 10 = ? and 10 × 8 = ? 
A)  8 − 10 = ? and 500 + 224 = ? 
B)  22 × 48 = ? and 48 + 22 =? 
C)  (−8) − (+10) = ? and 8 × 10 = ? 
D)  8 × 10 = ? and 10 × 8 = ?

Question 11

Which one of the following proposes separating sources of systematic error from random error in order to eliminate systematic error?

Accepted Answer

A)  classical test theory 
B)  generalizability theory 
C)  reliability theory 
D)  theory of the normal curve 
A)  classical test theory 
B)  generalizability theory 
C)  reliability theory 
D)  theory of the normal curve

Question 12

Identify and discuss the theory that explains why an observed test score is made up of the "true score" and "random error." Give examples.

Accepted Answer

@#LAT-DLM&Classical test theory: According to clas

Question 13

Which one of the following is most likely to decrease the reliability of a test?

Accepted Answer

A)  poorly written questions 
B)  unprepared test takers 
C)  to many test questions 
D)  overlapping confidence intervals 
A)  poorly written questions 
B)  unprepared test takers 
C)  to many test questions 
D)  overlapping confidence intervals

Question 14

As the interval between administrations lengthens, test-retest reliability will most likely ______.

Accepted Answer

A)  increase 
B)  decrease 
C)  vary unpredictably 
D)  remain unchanged 
A)  increase 
B)  decrease 
C)  vary unpredictably 
D)  remain unchanged

Question 15

Discuss Cohen's kappa. How is it used by test developers or researchers? Give an example.

Accepted Answer

@#LAT-DLM&Cohen's kappa provides a nonparametric i

Question 16

Which one of the following is most helpful to test developers who wish to increase the reliability/precision of a test's scores?

Accepted Answer

A)  Spearman Brown formula 
B)  coefficient alpha 
C)  correlation 
D)  Cohen's kappa 
A)  Spearman Brown formula 
B)  coefficient alpha 
C)  correlation 
D)  Cohen's kappa

Question 17

Explain what the standard error of measurement is and how to use it to construct a confidence interval around an observed score.

Accepted Answer

@#LAT-DLM&The SEM is an estimate of how much the i

Question 18

When a test score is used for selection or classification of individuals, it is advisable to calculate the standard error of measurement at the ______.

Accepted Answer

A)  score used to make the classification decision 
B)  average score on the test 
C)  highest score on the test 
D)  lowest score on the test 
A)  score used to make the classification decision 
B)  average score on the test 
C)  highest score on the test 
D)  lowest score on the test

Question 19

What do we call the statistic that reflects the amount of inconsistency or error expected in an individual's test score?

Accepted Answer

A)  reliability coefficient 
B)  standard deviation 
C)  standard error of measurement 
D)  correlation coefficient 
A)  reliability coefficient 
B)  standard deviation 
C)  standard error of measurement 
D)  correlation coefficient

Question 20

Which one of the following is used for calculating internal consistency for tests whose questions can be scored as either right or wrong?

Accepted Answer

A)  split halves method 
B)  test-retest method 
C)  coefficient alpha 
D)  KR-20 formula 
A)  split halves method 
B)  test-retest method 
C)  coefficient alpha 
D)  KR-20 formula

A nonparametric index for scorer agreement when the scores are nominal or ordinal is provided by ______.

As the reliability/precision of a test decreases, which one of the following items increases?

According to classical test theory, what would the reliability coefficient be when the variance of observed scores is equal to the variance of true scores?

What is the formula that Cronbach proposed for calculating internal consistency for questions that have more than two possible responses called?

Which one of the following is required to yield an accurate estimate of reliability/precision using the split halves method?

If a meteorologist uses a thermometer that always reads 1 degree higher than the actual temperature, then the error that results is . If a meteorologist is nearsighted and he reads the thermometer with a different amount and direction of inaccuracy each time, the error that results will be .

What is the unexplained difference between the true score (T) and the obtained score (X) called?

What do we call changes in test scores resulting from the sequence in which the tests were taken?

Rita scored 96 on an employment test, and Naomi scored 98 on the same test. Naomi believes that she has the highest score, but Rita disagrees. Which of the following would be most helpful in determining whether Naomi's score is statistically higher than Rita's score?

Which one of the following pairs of math questions would be most likely to produce an internally consistent result?

Which one of the following proposes separating sources of systematic error from random error in order to eliminate systematic error?

Identify and discuss the theory that explains why an observed test score is made up of the "true score" and "random error." Give examples.

Which one of the following is most likely to decrease the reliability of a test?

As the interval between administrations lengthens, test-retest reliability will most likely ______.

Discuss Cohen's kappa. How is it used by test developers or researchers? Give an example.

Which one of the following is most helpful to test developers who wish to increase the reliability/precision of a test's scores?

Explain what the standard error of measurement is and how to use it to construct a confidence interval around an observed score.

When a test score is used for selection or classification of individuals, it is advisable to calculate the standard error of measurement at the ______.

What do we call the statistic that reflects the amount of inconsistency or error expected in an individual's test score?

Which one of the following is used for calculating internal consistency for tests whose questions can be scored as either right or wrong?

What Are Psychological Tests

Why Is Psychological Testing Important

What Are the Ethical Responsibilities of Test Publishers, Test Users, and Test Takers

How Do Test Users Interpret Test Scores

How Do We Gather Evidence of Validity Based on the Content of a Test

How Do We Gather Evidence of Validity Based on Testcriterion Relationships

How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs

How Do We Construct and Administer Surveys and Use Survey Data

How Do We Develop a Test

How Do We Assess the Psychometric Quality of a Test

How Are Tests Used in Educational Settings

How Are Tests Used in Clinical and Counseling Settings

How Are Tests Used in Organizational Settings

Filters

Exam 5: What Is Test Reliabilityprecision

A nonparametric index for scorer agreement when the scores are nominal or ordinal is provided by ______.

As the reliability/precision of a test decreases, which one of the following items increases?

According to classical test theory, what would the reliability coefficient be when the variance of observed scores is equal to the variance of true scores?

What is the formula that Cronbach proposed for calculating internal consistency for questions that have more than two possible responses called?

Which one of the following is required to yield an accurate estimate of reliability/precision using the split halves method?

What is the unexplained difference between the true score (T) and the obtained score (X) called?

What do we call changes in test scores resulting from the sequence in which the tests were taken?

Rita scored 96 on an employment test, and Naomi scored 98 on the same test. Naomi believes that she has the highest score, but Rita disagrees. Which of the following would be most helpful in determining whether Naomi's score is statistically higher than Rita's score?

Which one of the following pairs of math questions would be most likely to produce an internally consistent result?

Which one of the following proposes separating sources of systematic error from random error in order to eliminate systematic error?

Identify and discuss the theory that explains why an observed test score is made up of the "true score" and "random error." Give examples.

Which one of the following is most likely to decrease the reliability of a test?

As the interval between administrations lengthens, test-retest reliability will most likely ______.

Discuss Cohen's kappa. How is it used by test developers or researchers? Give an example.

Which one of the following is most helpful to test developers who wish to increase the reliability/precision of a test's scores?

Explain what the standard error of measurement is and how to use it to construct a confidence interval around an observed score.

When a test score is used for selection or classification of individuals, it is advisable to calculate the standard error of measurement at the ______.

What do we call the statistic that reflects the amount of inconsistency or error expected in an individual's test score?

Which one of the following is used for calculating internal consistency for tests whose questions can be scored as either right or wrong?

What Are Psychological Tests

Why Is Psychological Testing Important

What Are the Ethical Responsibilities of Test Publishers, Test Users, and Test Takers

How Do Test Users Interpret Test Scores

How Do We Gather Evidence of Validity Based on the Content of a Test

How Do We Gather Evidence of Validity Based on Testcriterion Relationships

How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs

How Do We Construct and Administer Surveys and Use Survey Data

How Do We Develop a Test

How Do We Assess the Psychometric Quality of a Test

How Are Tests Used in Educational Settings

How Are Tests Used in Clinical and Counseling Settings

How Are Tests Used in Organizational Settings

Filters