Question 1

What do we mean when we say that a test is internally consistent?

Accepted Answer

A)  a test taker only takes the test once 
B)  a test taker's scores will remain similar over time 
C)  the test questions are measuring a similar concept 
D)  the scores of a group of test takers will be very similar 
A)  a test taker only takes the test once 
B)  a test taker's scores will remain similar over time 
C)  the test questions are measuring a similar concept 
D)  the scores of a group of test takers will be very similar

Question 2

Describe how to gather evidence of reliability using the split halves method. Start your discussion at the time the test is administered and continue until the final numerical value is calculated and interpreted.

Accepted Answer

@#LAT-DLM&Administer the test to a large group of

Question 3

The range of scores that we feel comfortable and includes the true score is called a ______.

Accepted Answer

A)  standard deviation 
B)  standard error of measurement 
C)  confidence interval 
D)  normal curve 
A)  standard deviation 
B)  standard error of measurement 
C)  confidence interval 
D)  normal curve

Question 4

Julio wants to calculate the interrater agreement for an essay exam that is scored by giving each essay a pass (2) or fail (1) mark. Which one of the following would be most appropriate for Julio to use?

Accepted Answer

A)  Cohen's kappa 
B)  coefficient alpha 
C)  KR-20 
D)  Correlation 
A)  Cohen's kappa 
B)  coefficient alpha 
C)  KR-20 
D)  Correlation

Question 5

What could a test developer do to increase internal consistency of a test?

Accepted Answer

A)  accurately measure the test-retest reliability of the test 
B)  add well-written questions to each test form 
C)  add questions that measure the same concept 
D)  adjust the reliability coefficient using the KR-20 formula 
A)  accurately measure the test-retest reliability of the test 
B)  add well-written questions to each test form 
C)  add questions that measure the same concept 
D)  adjust the reliability coefficient using the KR-20 formula

Question 6

What is the best way to divide the test when using the split-half method?

Accepted Answer

A)  put the first questions in one half and the last questions in the other half 
B)  put all multiple choice questions in one half and all essay questions in the other half 
C)  randomly assign each question to the first half or the second half 
D)  assign odd-numbered questions to one half and even-numbered questions to the other 
A)  put the first questions in one half and the last questions in the other half 
B)  put all multiple choice questions in one half and all essay questions in the other half 
C)  randomly assign each question to the first half or the second half 
D)  assign odd-numbered questions to one half and even-numbered questions to the other

Question 7

What do we call a single source of error that always increases or decreases the true score by the same amount?

Accepted Answer

A)  the true score 
B)  the average score 
C)  random error 
D)  systematic error 
A)  the true score 
B)  the average score 
C)  random error 
D)  systematic error

Question 8

What is the term used to describe the consistency of test scores?

Accepted Answer

A)  validity 
B)  reliability/precision 
C)  distribution 
D)  standard deviation 
A)  validity 
B)  reliability/precision 
C)  distribution 
D)  standard deviation

Question 9

Jonathan wanted to estimate the internal consistency of a multiple choice test. Which one of the following would be most appropriate for him to use?

Accepted Answer

A)  Spearman Brown 
B)  coefficient alpha 
C)  Cohen's kappa 
D)  KR-20 
A)  Spearman Brown 
B)  coefficient alpha 
C)  Cohen's kappa 
D)  KR-20

Question 10

Estimating reliability/precision using methods of internal consistency is appropriate only for tests that are ______.

Accepted Answer

A)  heterogeneous 
B)  homogeneous 
C)  unstandardized 
D)  standardized 
A)  heterogeneous 
B)  homogeneous 
C)  unstandardized 
D)  standardized

Question 11

Which one of the following statements regarding test reliability is TRUE?

Accepted Answer

A)  Researchers must choose one method of estimating the reliability/precision of test scores. 
B)  Researchers can identify the causes of random error. 
C)  No measurement instrument is perfectly reliable or consistent. 
D)  A measurement instrument should be perfectly reliable or consistent. 
A)  Researchers must choose one method of estimating the reliability/precision of test scores. 
B)  Researchers can identify the causes of random error. 
C)  No measurement instrument is perfectly reliable or consistent. 
D)  A measurement instrument should be perfectly reliable or consistent.

Question 12

Theoretically, if a test taker took a test, an infinite number of times and an average score was calculated from those administrations, the average test score would ______.

Accepted Answer

A)  equal the true test score 
B)  contain the true score and error 
C)  contain only error 
D)  have no meaning 
A)  equal the true test score 
B)  contain the true score and error 
C)  contain only error 
D)  have no meaning

Question 13

Chris wants to calculate the interscorer reliability for an essay test that had two scorers. Which one of the following would be most appropriate for Chris to use?

Accepted Answer

A)  Cohen's kappa 
B)  coefficient alpha 
C)  KR-20 
D)  Correlation 
A)  Cohen's kappa 
B)  coefficient alpha 
C)  KR-20 
D)  Correlation

Question 14

When using the split halves method of estimating reliability/precision, which one of the following requires adjustment to compensate for splitting the test into halves?

Accepted Answer

A)  assignment of the test questions 
B)  correlation method 
C)  the reliability coefficient 
D)  the test scores 
A)  assignment of the test questions 
B)  correlation method 
C)  the reliability coefficient 
D)  the test scores

Question 15

What is the amount of consistency among scorers' judgments called?

Accepted Answer

A)  test-retest agreement 
B)  interscorer agreement 
C)  intrascorer agreement 
D)  internal agreement 
A)  test-retest agreement 
B)  interscorer agreement 
C)  intrascorer agreement 
D)  internal agreement

Question 16

Scorer reliability and agreement concerns the consistency of what?

Accepted Answer

A)  test scores 
B)  scorer judgments 
C)  different test forms 
D)  test takers' performance 
A)  test scores 
B)  scorer judgments 
C)  different test forms 
D)  test takers' performance

Question 17

Cohen's kappa is a statistical method for ______.

Accepted Answer

A)  estimating test-retest reliability 
B)  estimating interrater agreement 
C)  estimating internal consistency 
D)  correlating ratings by two judges 
A)  estimating test-retest reliability 
B)  estimating interrater agreement 
C)  estimating internal consistency 
D)  correlating ratings by two judges

Question 18

According to classical test theory, what will the reliability coefficient be when the observed score variance is greater than true score variance?

Accepted Answer

A)  0 
B)  less than 1.0 
C)  exactly 1.0 
D)  over 1.0 
A)  0 
B)  less than 1.0 
C)  exactly 1.0 
D)  over 1.0

Question 19

When researchers want to measure test-retest reliability/precision, they must assume test takers' ability will ______.

Accepted Answer

A)  not change between the first administration and the second administration 
B)  increase between the first administration and the second administration 
C)  decrease between the first administration and the second administration 
D)  be affected by the order they took the tests 
A)  not change between the first administration and the second administration 
B)  increase between the first administration and the second administration 
C)  decrease between the first administration and the second administration 
D)  be affected by the order they took the tests

Question 20

When tests are heterogeneous, estimates of internal consistency are likely to be ______.

Accepted Answer

A)  low 
B)  high 
C)  comparable 
D)  homogeneous 
A)  low 
B)  high 
C)  comparable 
D)  homogeneous

What do we mean when we say that a test is internally consistent?

Describe how to gather evidence of reliability using the split halves method. Start your discussion at the time the test is administered and continue until the final numerical value is calculated and interpreted.

The range of scores that we feel comfortable and includes the true score is called a ______.

Julio wants to calculate the interrater agreement for an essay exam that is scored by giving each essay a pass (2) or fail (1) mark. Which one of the following would be most appropriate for Julio to use?

What could a test developer do to increase internal consistency of a test?

What is the best way to divide the test when using the split-half method?

What do we call a single source of error that always increases or decreases the true score by the same amount?

What is the term used to describe the consistency of test scores?

Jonathan wanted to estimate the internal consistency of a multiple choice test. Which one of the following would be most appropriate for him to use?

Estimating reliability/precision using methods of internal consistency is appropriate only for tests that are ______.

Which one of the following statements regarding test reliability is TRUE?

Theoretically, if a test taker took a test, an infinite number of times and an average score was calculated from those administrations, the average test score would ______.

Chris wants to calculate the interscorer reliability for an essay test that had two scorers. Which one of the following would be most appropriate for Chris to use?

When using the split halves method of estimating reliability/precision, which one of the following requires adjustment to compensate for splitting the test into halves?

What is the amount of consistency among scorers' judgments called?

Scorer reliability and agreement concerns the consistency of what?

Cohen's kappa is a statistical method for ______.

According to classical test theory, what will the reliability coefficient be when the observed score variance is greater than true score variance?

When researchers want to measure test-retest reliability/precision, they must assume test takers' ability will ______.

When tests are heterogeneous, estimates of internal consistency are likely to be ______.

What Are Psychological Tests

Why Is Psychological Testing Important

What Are the Ethical Responsibilities of Test Publishers, Test Users, and Test Takers

How Do Test Users Interpret Test Scores

How Do We Gather Evidence of Validity Based on the Content of a Test

How Do We Gather Evidence of Validity Based on Testcriterion Relationships

How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs

How Do We Construct and Administer Surveys and Use Survey Data

How Do We Develop a Test

How Do We Assess the Psychometric Quality of a Test

How Are Tests Used in Educational Settings

How Are Tests Used in Clinical and Counseling Settings

How Are Tests Used in Organizational Settings

Filters

Exam 5: What Is Test Reliabilityprecision

What do we mean when we say that a test is internally consistent?

Describe how to gather evidence of reliability using the split halves method. Start your discussion at the time the test is administered and continue until the final numerical value is calculated and interpreted.

The range of scores that we feel comfortable and includes the true score is called a ______.

Julio wants to calculate the interrater agreement for an essay exam that is scored by giving each essay a pass (2) or fail (1) mark. Which one of the following would be most appropriate for Julio to use?

What could a test developer do to increase internal consistency of a test?

What is the best way to divide the test when using the split-half method?

What do we call a single source of error that always increases or decreases the true score by the same amount?

What is the term used to describe the consistency of test scores?

Jonathan wanted to estimate the internal consistency of a multiple choice test. Which one of the following would be most appropriate for him to use?

Estimating reliability/precision using methods of internal consistency is appropriate only for tests that are ______.

Which one of the following statements regarding test reliability is TRUE?

Theoretically, if a test taker took a test, an infinite number of times and an average score was calculated from those administrations, the average test score would ______.

Chris wants to calculate the interscorer reliability for an essay test that had two scorers. Which one of the following would be most appropriate for Chris to use?

When using the split halves method of estimating reliability/precision, which one of the following requires adjustment to compensate for splitting the test into halves?

What is the amount of consistency among scorers' judgments called?

Scorer reliability and agreement concerns the consistency of what?

Cohen's kappa is a statistical method for ______.

According to classical test theory, what will the reliability coefficient be when the observed score variance is greater than true score variance?

When researchers want to measure test-retest reliability/precision, they must assume test takers' ability will ______.

When tests are heterogeneous, estimates of internal consistency are likely to be ______.

What Are Psychological Tests

Why Is Psychological Testing Important

What Are the Ethical Responsibilities of Test Publishers, Test Users, and Test Takers

How Do Test Users Interpret Test Scores

How Do We Gather Evidence of Validity Based on the Content of a Test

How Do We Gather Evidence of Validity Based on Testcriterion Relationships

How Do We Gather Evidence of Validity Based on a Tests Relation to Constructs

How Do We Construct and Administer Surveys and Use Survey Data

How Do We Develop a Test

How Do We Assess the Psychometric Quality of a Test

How Are Tests Used in Educational Settings

How Are Tests Used in Clinical and Counseling Settings

How Are Tests Used in Organizational Settings

Filters