A Drawback of Using Percent Agreement to Assess Interrater Reliability

Multiple Choice

A drawback of using percent agreement to assess interrater reliability is that it:

A) may understate the degree of agreement, especially if an exact match is used to define agreement.
B) gives you only a raw estimate of agreement.
C) may overstate the degree of agreement when behaviors occur with very high or low frequency, as these have high levels of chance agreement.
D) All of the answers are correct.