Question 1

What are the three different types of reliability and how do they differ?

Accepted Answer

The three different types of reliability are test-retest reliability, inter-rater reliability, and internal consistency reliability.

Test-retest reliability refers to the consistency of a measure when it is administered to the same group of people at two different points in time. This type of reliability assesses whether the results of a test are stable over time.

Inter-rater reliability, on the other hand, measures the consistency of a measure when it is rated or scored by different raters or observers. This type of reliability is important in fields such as psychology and education, where subjective judgments are often made.

Internal consistency reliability assesses the consistency of results across different items within a single measure. This type of reliability is commonly measured using statistical techniques such as Cronbach's alpha, and it indicates whether all the items in a measure are measuring the same underlying construct.

Overall, these three types of reliability differ in terms of what they measure and how they are assessed, but they all aim to ensure that a measure is consistent and dependable in its results.

Question 2

The concept of reliability refers to:

Accepted Answer

A)  The internal stability of a test or measure 
B)  The degree to which a test measures what it purports to measure 
C)  How consistent the test taker is in answering test questions 
D)  None of the above. A

Question 3

If a test has construct validity then which of the following statements are true?

Accepted Answer

A)  The test correlates highly with other tests that measure the same and different constructs 
B)  The test correlates highly with another test measuring a different construct and has little correlation with another test measuring a similar construct 
C)  The test correlates highly with another test measuring the same construct and has little correlation with a test measuring a different construct 
D)  The validity coefficient is greater than the test's reliability coefficient C

Question 4

When using psychological tests to make predictions about an individual's future status, for example diagnosis, or behavior, tests will be most helpful when the condition of behavior in question has a base rate of:

Accepted Answer

A)  99% 
B)  50% approximately 
C)  Less than 10% 
D)  Between 1 and 10%

Question 5

This exam is an example of a ______________ test; whereas the NEO-PI-R is an example of a____________ test.

Accepted Answer

A)  Reliable; valid 
B)  Valid; reliable 
C)  Norm referenced, criterion- referenced 
D)  Criterion- referenced; norm-referenced

Question 6

Counselors may decide to use a test based on its sensitivity. Sensitivity refers to:

Accepted Answer

A)  The cultural sensitivity of a test 
B)  The ability of a test to have few false negatives 
C)  The ability of a test to accurately identify an individual as having a condition or disorder 
D)  The ability of a test to accurately identify as not having a condition or disorder

Question 7

A common internal consistency reliability measure is:

Accepted Answer

A)  The T-test 
B)  Standard error of measurement 
C)  Coefficient alpha 
D)  Pearson R squared

Question 8

According to classical test theory which of the following statements is true?

Accepted Answer

A)  A test score is equal to the true score plus or minus test error 
B)  Reliability is an estimate of the ratio of true test score variance to observed test variance 
C)  The more reliable a test is the less unsystematic error is associated with it. 
D)  All of the above

Question 9

The developer of a new personality test wanted the test's norms to be comprised of certain percentages of different racial-ethnic groups, therefore she used a ___________ technique for obtaining the standardization group.

Accepted Answer

A)  Stratified sampling 
B)  U.S. Census info generating 
C)  Random sampling. 
D)  Criterion cluster driven.

Question 10

A counselor researcher developed a new PTSD test. She gave the test to 100 clients and also gave those same clients two other tests, the Beck Anxiety Inventory and the Mini Mental Status Evaluation. She correlated the scores of the tests in order to assess the ____________ of her PTSD test.

Accepted Answer

A)  Internal Consistency 
B)  Construct validity 
C)  Face Validity 
D)  Split-half reliability

Question 11

The statistic that quantifies the degree to which a test can predict the range of scores on some kind of outcome measure or criterion is the:

Accepted Answer

A)  Coefficient of Determination 
B)  Regression factor 
C)  Alpha Coefficient 
D)  Kuder Richardson Scale

Question 12

The Pearson r correlation coefficient is used to measure

Accepted Answer

A)  The test re-test reliability of a test 
B)  The predictive validity of a test 
C)  The construct validity of a test 
D)  All of the above

Question 13

How do test developers demonstrate evidence of their test's construct validity?

Accepted Answer

The answer of How do test developers demonstrate evidence of...

Question 14

A researcher determined that two variables were correlated. Which of the following statements would be a true statement about the strength of this relationship:

Accepted Answer

A)  A correlation of .3 is stronger than a correlation of .75 
B)  A correlation of -1.0 equals a correlation of 0.0 
C)  A correlation of -.75 is stronger than a correlation of .3 
D)  A correlation of 1.0 is stronger than a correlation of -1.0.

Question 15

What does the correlation coefficient measure?

Accepted Answer

The answer of What does the correlation coefficient measure?...

Question 16

The concept of incremental validity refers to:

Accepted Answer

A)  The ability of multiple assessments used in combination to make accurate predictions 
B)  How many pieces of information a counselor can accurately recall from an assessment 
C)  A statistical process for measuring the accuracy of a test based on its size 
D)  An assessment battery in which each test that is used has greater predictive validity than the previous one

Question 17

What does the concept of incremental validity mean?

Accepted Answer

The answer of What does the concept of incremental validity...

Question 18

Which psychometric factors need to be considered when choosing a test or measure?

Accepted Answer

The answer of Which psychometric factors need to be considered...

Question 19

The reliability of a test can be affected by:

Accepted Answer

A)  The number of individuals in the normative sample 
B)  The number of items on the test 
C)  The degree of difficulty of the test items 
D)  The response format of the test

Exam 7: Reliability and Validity