How can I compute Cohen's Kappa and PABAK in R?

Question

I would like to compute the interrater agreement of two raters for variables with two or more categories. However, I assume that there will be a prevalence problem (i.e. certain categories are likely to appear more often in the data than others). Thus, I am interested in also getting the prevalence-adjusted bias-adjusted kappa (PABAK). As far as I have seen, the package {IRR} does not offer this option, but the epi.kappa function of {epiR} does so. However, I would prefer to use {IRR} as I would like to get Cohen's Kappa (epiR seems to be based on Fleiss' Kappa). Is there any other way in which I could obtain Cohen's Kappa and PABAK in R?

Thank you very much!

Please provide enough code so others can better understand or reproduce the problem. — Community, Nov 30 '21 at 13:14

score 0 · Answer 1 · answered Nov 29 '21 at 00:24

0

Mark Stevenson here, developer of the epiR package. I've updated the epi.kappa function in epiR to include Cohen's kappa as an option. I'll submit to CRAN shortly. Contact me by email if you'd like a pre-release version.

answered Nov 29 '21 at 00:24

Mark Stevenson

1

"Contact me by email"—that's not how things work here. Please take the [tour] and read [answer]. – ChrisGPT was on strike Nov 29 '21 at 01:10

How can I compute Cohen's Kappa and PABAK in R?

1 Answers1