AGREL-package: Package for calculating agreement/reliability indices

In BavoDC/AGREL: Package for calculating agreement/reliability indices

Description

Contains functions to compute Cohen's Kappa, Fleiss' Kappa, Gwet's AC1 and AC2, Krippendorf's alpha, Conger's kappa, Brennan-Prediger coefficient, as well as a function to compute a matrix with Kappa-type coefficients for assessing the reliability of nominal scales.

Author(s)

De Cock Bavo

Maintainer: De Cock Bavo <[e-mail]>

References

Cohen, J. (1960). A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, Vol.20(1), pp.37-46

Cohen, J. (1968).Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological Bulletin, Vol.70(4), pp.213-220

De Vet HCW, Mokkink LB, Terwee CB, Hoekstra OS, Knol DL. Clinicians are right not to like Cohen’s k. BMJ 2013;346:f2125.

de Vet, H.C.W., Terwee C.B., Knol, D.L., Bouter, L.M. (2006). When to use agreement versus reliability measures. Journal of Clinical Epidemiology, Vol.59(10), pp.1033-1039

de Vet, H.C.W., Dikmans, R.E., Eekhout, I. (2017). Specific agreement on dichotomous outcomes can be calculated for more than two raters. Journal of Clinical Epidemiology, Vol.83, pp.85-89

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, Vol.76(5), pp.378-382

Fleiss J.L., Davies M. (1982). Jackknifing functions of multinomial frequencies, with an application to a measure of concordance. Am J Epidemiol;115: 841-845.

Uebersax, J.S. (1982). A design-independent method for measuring the reliability of psychiatric diagnosis. Journal of Psychiatric Research, Vol.17(4), pp.335-342

See Also

AgreemGeneralizedVector CohenK ConfintJack DiagnosticAgreement.deVet FleissK Kappa.Matrix

Examples

# Vignette of package
vignette(package = "AGREL")

# Load data
data(Agreement_deVetArticle)

# Specific and overall agreement, dichotomous variable
DiagnosticAgreement.deVet(Agreement_deVetArticle)

# Specific and overall agreement, multinomial variable
data(PsychMorbid)
AgreemGeneralizedVector(PsychMorbid)

# Cohen's Kappa
Df = Agreement_deVetArticle[,1:2]
Results1 = CohenK(Df)
Results1
ConfintJack(Results1)

# Fleiss' Kappa
FleissK(Agreement_deVetArticle)

BavoDC/AGREL documentation built on May 6, 2019, 7:22 a.m.