Question 1

Interrater reliability measures consistency ______.

Accepted Answer

A) over time 
B) from form to form 
C) across different tests 
D) from rater to rater 
A) over time 
B) from form to form 
C) across different tests 
D) from rater to rater

Question 2

Observed score equals the true score minus error score.

Accepted Answer

A) True 
 B)False

Question 3

If you want to know if the items on a test assess one and only one dimension, what type of reliability do you use?

Accepted Answer

A) parallel forms reliability 
B) test-retest reliability 
C) interrater reliability 
D) internal consistency reliability 
A) parallel forms reliability 
B) test-retest reliability 
C) interrater reliability 
D) internal consistency reliability

Question 4

A test can be valid but not reliable, but it is impossible to have a test that is reliable and not valid.

Accepted Answer

A) True 
 B)False

Question 5

The number of agreements between your two raters divided by the total number of possible agreements is the way to calculate _______.

Accepted Answer

A) parallel forms reliability 
B) multiple judges reliability 
C) interrater reliability 
D) multiple judges validity 
A) parallel forms reliability 
B) multiple judges reliability 
C) interrater reliability 
D) multiple judges validity

Question 6

If you want to know that a test measures some underlying psychological construct, what type of validity evidence would you want to collect?

Accepted Answer

A) content validity 
B) construct validity 
C) predictive validity 
D) concurrent validity 
A) content validity 
B) construct validity 
C) predictive validity 
D) concurrent validity

Question 7

_______ is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the present.

Accepted Answer

A) content validity 
B) predictive validity 
C) concurrent criterion validity 
D) test-retest validity 
A) content validity 
B) predictive validity 
C) concurrent criterion validity 
D) test-retest validity

Question 8

Two trained professionals observe the behavior of children in a classroom.They each rate observed behaviors using the same form, and the number of items that were rated the same is calculated.This is an example of which type of reliability?

Accepted Answer

A) parallel forms 
B) test-retest 
C) interrater 
D) internal consistency 
A) parallel forms 
B) test-retest 
C) interrater 
D) internal consistency

Question 9

The maximum level of validity possible is equal to ______.

Accepted Answer

A) the square of the reliability coefficient 
B) the square root of the reliability coefficient 
C) the cube of the reliability coefficient 
D) the square root of the reliability coefficient, plus one 
A) the square of the reliability coefficient 
B) the square root of the reliability coefficient 
C) the cube of the reliability coefficient 
D) the square root of the reliability coefficient, plus one

Question 10

Reliability and validity should be considered ______.

Accepted Answer

A) before you start analyzing data 
B) after data have been analyzed 
C) when data are being collected 
D) in regard to research on human subjects only 
A) before you start analyzing data 
B) after data have been analyzed 
C) when data are being collected 
D) in regard to research on human subjects only

Question 11

If your test is not reliable, you must try to lower your error.

Accepted Answer

A) True 
 B)False

Question 12

Internal consistency reliability tests how each individual item scores correlates with the total score.

Accepted Answer

A) True 
 B)False

Question 13

Which of the following is NOT a measure of validity?

Accepted Answer

A) content validity 
B) parallel forms validity 
C) criterion validity 
D) construct validity 
A) content validity 
B) parallel forms validity 
C) criterion validity 
D) construct validity

Question 14

To use archery practice as a metaphor for reliability and validity, hitting the bull's-eye of a target demonstrates _______, whereas repeatedly hitting the target in the same small area demonstrates _______.

Accepted Answer

validity;

Question 15

Why can we not know the true score for a test?

Accepted Answer

We cannot ever know the true s

Question 16

High school class rank is highly correlated with college GPA.This is an example of what type of validity?

Accepted Answer

A) concurrent validity 
B) predictive validity 
C) content validity 
D) construct validity 
A) concurrent validity 
B) predictive validity 
C) content validity 
D) construct validity

Question 17

If the measures associated with a test are said to be consistent, you might conclude that the measure is _______.

Accepted Answer

A) standard 
B) valid 
C) reliable 
D) concurrent 
A) standard 
B) valid 
C) reliable 
D) concurrent

Question 18

In experiment, the treatment is called ______.

Accepted Answer

A) dependent variable 
B) independent variable 
C) intervening variable 
D) mediating variable 
A) dependent variable 
B) independent variable 
C) intervening variable 
D) mediating variable

Question 19

Interrater reliability is an example of which of the following?

Accepted Answer

A) measure of consistency 
B) measure of stability 
C) measure of agreement 
D) measure of equivalence 
A) measure of consistency 
B) measure of stability 
C) measure of agreement 
D) measure of equivalence

Question 20

If I can say that my weekly statistics quiz fairly assesses the material covered, what source of validity evidence should I have collected?

Accepted Answer

A) criterion validity 
B) content validity 
C) construct validity 
D) concurrent validity 
A) criterion validity 
B) content validity 
C) construct validity 
D) concurrent validity

Exam 6: Just the Truth: An Introduction to Understanding Reliability and Validity

Interrater reliability measures consistency ______.

Observed score equals the true score minus error score.

If you want to know if the items on a test assess one and only one dimension, what type of reliability do you use?

A test can be valid but not reliable, but it is impossible to have a test that is reliable and not valid.

The number of agreements between your two raters divided by the total number of possible agreements is the way to calculate _______.

If you want to know that a test measures some underlying psychological construct, what type of validity evidence would you want to collect?

_______ is the type of validity that examines how well a test outcome is consistent with a criterion that occurs in the present.

Two trained professionals observe the behavior of children in a classroom.They each rate observed behaviors using the same form, and the number of items that were rated the same is calculated.This is an example of which type of reliability?

The maximum level of validity possible is equal to ______.

Reliability and validity should be considered ______.

If your test is not reliable, you must try to lower your error.

Internal consistency reliability tests how each individual item scores correlates with the total score.

Which of the following is NOT a measure of validity?

To use archery practice as a metaphor for reliability and validity, hitting the bull's-eye of a target demonstrates _______, whereas repeatedly hitting the target in the same small area demonstrates _______.

Why can we not know the true score for a test?

High school class rank is highly correlated with college GPA.This is an example of what type of validity?

If the measures associated with a test are said to be consistent, you might conclude that the measure is _______.

In experiment, the treatment is called ______.

Interrater reliability is an example of which of the following?

If I can say that my weekly statistics quiz fairly assesses the material covered, what source of validity evidence should I have collected?

Statistics or Sadistics Its up to You

Means to an End: Computing and Understanding Averages

Vive La Différence: Understanding Variability

A Picture Really Is Worth a Thousand Words

Ice Cream and Crime: Computing Correlation Coefficients

Hypotheticals and You: Testing Your Questions

Are Your Curves Normal Probability and Why It Counts

Significantly Significant: What It Means for You and Me

Only the Lonely: The One Sample Z-Test

Tea for Two: Tests Between the Means of Different Groups

Tea for Two Again: Tests Between the Means of Related Groups

Two Groups Too Many Try Analysis of Variance

Two Too Many Factors: Factorial Analysis of Variancea Brief Introduction

Cousins or Just Good Friends Testing Relationships Using Correlation Coefficient

Predicting Wholl Win the Super Bowl: Using Linear Regression

What to Do When Youre Not Normal: CHI-Square and Some Other Nonparametric Tests

Some Other Important Statistical Procedures You Should Know About

Data Mining: An Introduction to Getting the Most Out of Your Big Data

A Statistical Software Sampler

The Ten or More Best and Most Fun Internet Sites for Statistics Stuff

The Ten Commandments of Data Collection

Filters

To use archery practice as a metaphor for reliability and validity, hitting the bull's-eye of a target demonstrates _, whereas repeatedly hitting the target in the same small area demonstrates _.